25

Fixed again and I'm going to bed.

Broken Again. I tried to fix a problem with the Nanny Forums and something went wrong. Working on it now.

This evening I was doing some maintenance on the database cluster when suddenly an error message appeared and the forums stopped working. The cluster consists of four nodes and two of them had crashed completely and two were in a not-working state. I tried several times to bring the cluster back up, but what appears to be a corrupt file prevented that. I am now restoring yesterday's backup. Unfortunately, since backups are done at night, any post or thread from about 4 am Friday morning will be lost.

UPDATE: The DCUM Forums are back up but are working very slowly. Posting is very slow. The page times out but the posts actually go through. Please don't resubmit because that will cause duplicate posts. Recent Topics also doesn't seem to be working.