Yesterday we had a total melt down of one of the machines and the FULL master database on another machine. In short, everything was lost.
Luckily, we do daily back-ups. Had there been no backup, there'd be no more WinCustomize or forums or JoeUser. It was the most serious system failure we've ever had. The daily backups of course mean we lost everything that happened yesterday -- orders, posts, skins, you name it.
It's also another reason why WinCustomize subscriptions are so important. Thanks to subscribers, we have the extra hardware to do those backups. If we had even more subscribers, we could do real-time mirroring of these kinds of things and the melt down would not have even lost anything. But last night, the end of WinCustomize as we knew it came very close. Thank you subscribers for having provided the funds to have the extra hardware for us to be able to do daily backups and be able to quickly bring the site back.
In the meantime, you will find that there are weird errors as some indexes are wrong and that kind of thing. We'll be trying to address that in the coming days.
