Kris

joined 11 months ago
[–] Kris@feddit.org 3 points 2 months ago (1 children)

Thanks. Should be back in a few hours hopefully.

[–] Kris@feddit.org 7 points 2 months ago

A KVM is basically a second computer that acts as a virtual screen and keyboard that can be connected to the server to remote control it as if you were physically in front of it, including hardware resets and access to the bios etc.

[–] Kris@feddit.org 4 points 2 months ago (2 children)

I bought a KVM for that purpose, but didn't get around installing it.

The other person able to do it manually will be available the same time as me more or less so I don't want to bother them.

[–] Kris@feddit.org 16 points 2 months ago (1 children)

Yeah, I need to work on the busfactor.

The last time it went down was a similar situation and all the stuff I planned to prevent it next time I procastrinated on because the server was stable 🤦

[–] Kris@feddit.org 6 points 2 months ago

No one knows 🤷

[–] Kris@feddit.org 5 points 2 months ago (4 children)

It is a work trip to the middle east. I am unlucky with work trips and server maintenance 😓

[–] Kris@feddit.org 48 points 2 months ago (20 children)

poVoq here. After a string of bad luck it looks like I will not be able to get it back up before Tuesday evening. Super annoying.

[–] Kris@feddit.org 3 points 11 months ago

We managed to resolve the issue and I have many ideas how to avoid this in the future 🤓

[–] Kris@feddit.org 3 points 11 months ago (1 children)

Time to come back, it is working again. Lucky break 😅

[–] Kris@feddit.org 1 points 11 months ago

Slrpnk.net is unexpectatly back online 🥳

[–] Kris@feddit.org 4 points 11 months ago (1 children)

I think we will try to come up with a theme for Piefed with similar colors.

[–] Kris@feddit.org 1 points 11 months ago (1 children)

The backups are most likely fine 😅

354
submitted 11 months ago* (last edited 11 months ago) by Kris@feddit.org to c/fediverse@lemmy.world
 

Edit: unexpectatly we are back online. Will share how we found a solution later. There might be still some federation issues though.

Alt account of poVoq@slrpnk.net here.

Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.

I am still trying a few things, but I am not very optimistic that I can get access.

The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.

As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable 😓

I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing 😥

Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.

view more: next ›