News from Assembly 2010: Renderfarm.fi experiencing "slight issues"
Thursday morning we experienced a meltdown of the scale that we've never experienced before. Nice timing too! I'd just picked up Janus Kristensen and Kalle Max Hofmann from the airport when I heard the news. First I was hopeful, then melancholic, then angry at myself for not backing everything up, then again hopeful, melancholic .. well you get the idea. It's almost like this nice video of a Finnish drinking evening (by "those awful Swedes" ;-).
Basically what happened was that because of the huge sessions that we'd been taking on, we actually ran out of diskspace on the server, which in combination with a screaming database caused the meltdown. Actually we'd done this before, but recovered without any serious side-effects - which probably led me into believing that it's not that big of an issue. Well, lesson learned for yours truly. Couple this with the fact that backups are quite non-existent at the moment (another thing that's getting "a bit" more attention from now on) and you have a major screw up in your hands.
Anyway now it seems that not all is lost. Although we haven't still turned on the back-end, the UI (basically Drupal) seems to be nearly back in shape. We will try to get the BOINC side up and running as soon as possible. Meanwhile, here's us at our fantastically helpful ISP Otaverkko, who went out of their way to help us. This is us on at their main server hall, wondering what's up with our fantastic Dell Edge server (picture of that coming up later).
PS. Apart from all this, unnecessary hassle Assembly is looking good and all the whole Blender.fi community is having a blast. More about this later when we have the time.
- prodigal_son's blog
- Login or register to post comments
Thanks for the support Manu. Actually the guys (thanks to some voodoo I will probably never understand) managed to get the BOINC/BURP side up and running already. Uploads and work should be able to continue as normal (though we will probably wait until the first days of the week to accept work - returning to routine after a crazy weekend like this can be a bit hard), even if the web front-end will take a bit more time to recover.


Been "witnessing" the crash here from home, the bad timing too, and just thought: Leave it as it is for now and enjoy the assembly. Fix it when assembly is over ;)
You guys deserve a break.