|
|
|
|
Thread title: TF Down Time |
|
|
|
|
|
Thread tools
Search this thread
Display Modes
|
|
06-02-2008, 02:07 PM
|
#1
|
Status: Request a custom title
Join date: Dec 2005
Location:
Expertise:
Software:
Posts: 1,182
|
TF Down Time
Hi,
Sorry for the recent downtime it has taken a whole day to try and debug what was going on - the main issue was that no errors were being thrown, so it made it very tricky.
Anyway I have narrowed it down to the plugins which are now all disabled - further investigation required to find out which one and why.
Thanks for your patience.
|
|
06-02-2008, 02:16 PM
|
#2
|
Status: Member
Join date: Jan 2008
Location: North East, UK
Expertise: HTML / CSS / PHP / JavaScript
Software: TextMate, Photoshop
Posts: 134
|
Okay, thanks for fixing - I thought you'd been hacked by some 11 year old nerd for a minute
|
|
06-02-2008, 02:20 PM
|
#3
|
Status: Member
Join date: Jul 2006
Location: soundwave.
Expertise:
Software:
Posts: 379
|
This has been happening alot lately...Mind me asking which plugins you've been experimenting with thats causing all this downtime?
|
|
06-02-2008, 02:28 PM
|
#4
|
Status: Request a custom title
Join date: Dec 2005
Location:
Expertise:
Software:
Posts: 1,182
|
Originally Posted by Wildcard
This has been happening alot lately...Mind me asking which plugins you've been experimenting with thats causing all this downtime?
|
There are loads of plugins, and I haven't narrowed it down yet to exactly which one it was, all I know is, is that it was a "plugin".
|
|
06-02-2008, 04:03 PM
|
#5
|
Status: Member
Join date: May 2006
Location:
Expertise:
Software:
Posts: 119
|
From the looks of it it had something to do with athe apache server because your WHM and cPanel were running fine.
|
|
06-02-2008, 04:34 PM
|
#6
|
Status: Member
Join date: Mar 2008
Location:
Expertise:
Software:
Posts: 166
|
Thanks for fixing it
|
|
06-02-2008, 04:40 PM
|
#7
|
Status: Senior Member
Join date: Oct 2006
Location: New York
Expertise:
Software:
Posts: 774
|
thats not the problem, your webhost, theplanet has had a huge power surge and the server building was shut off.
|
|
06-02-2008, 04:42 PM
|
#8
|
Status: Request a custom title
Join date: Feb 2005
Location: The Netherlands
Expertise:
Software:
Posts: 2,616
|
Originally Posted by phractured
thats not the problem, your webhost, theplanet has had a huge power surge and the server building was shut off.
|
Not all servers I believe - only EV1.
|
|
06-02-2008, 04:48 PM
|
#9
|
Status: Senior Member
Join date: Oct 2006
Location: New York
Expertise:
Software:
Posts: 774
|
yeah ev1, but it can't be coincidental that the board went down when the server outage happened.
|
|
06-02-2008, 06:04 PM
|
#10
|
Status: Request a custom title
Join date: Dec 2005
Location:
Expertise:
Software:
Posts: 1,182
|
Originally Posted by phractured
thats not the problem, your webhost, theplanet has had a huge power surge and the server building was shut off.
|
I think power surge is an understatement! Read the below. It also had something to do with the Plugins though - But I'm sure its also related to their "explosion" as well - I've got 2 servers there and both went awol at the same time - one yet to recover, so its to much of a coincidence in my book!
As previously committed, I would like to provide an update on where we stand following yesterday's explosion in our H1 data center. First, I would like to extend my sincere thanks for your patience during the past 28 hours. We are acutely aware that uptime is critical to your business, and you have my personal commitment that The Planet team will continue to work around the clock to restore your service.
As you have read, we have begun receiving some of the equipment required to start repairs. While no customer servers have been damaged or lost, we have new information that damage to our H1 data center is worse than initially expected. Three walls of the electrical equipment room on the first floor blew several feet from their original position, and the underground cabling that powers the first floor of H1 was destroyed.
There is some good news, however. We have found a way to get power to Phase 2 (upstairs, second floor) of the data center and to restore network connectivity. We will be powering up the air conditioning system and other necessary equipment within the next few hours. Once these systems are tested, we will begin bringing the 6,000 servers online. It will take four to five hours to get them all running.
We have brought in additional support from Dallas to have more hands and eyes on site to help with any servers that may experience problems. The call center has also brought in double staff to handle the increase in tickets we're expecting. Hopefully by sunrise tomorrow Phase 2 will be well on its way to full production.
Let me next address Phase 1 (first floor) of the data center and the affected 3,000 servers. The news is not as good, and we were not as lucky. The damage there was far more extensive, and we have a bigger challenge that will require a two-step process. For the first step, we have designed a temporary method that we believe will bring power back to those servers sometime tomorrow evening, but the solution will be temporary. We will use a generator to supply power through next weekend when the necessary gear will be delivered to permanently restore normal utility power and our battery backup system. During the upcoming week, we will be working with those customers to resolve issues.
We know this may not be a satisfactory solution for you and your business but at this time, it is the best we can do.
We understand that you will be due service credits based on our Service Level Agreement. We will proactively begin providing those following the restoration of service, which is our number priority, so please bear with us until this has been completed.
I recognize that this is not all good news. I can only assure you we will continue to utilize every means possible to fully restore service.
I plan to have an audio update tomorrow evening.
Until then,
Douglas J. Erwin
Chairman & Chief Executive Officer
|
|
|
|
|
|
|
|
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
|
|
|
|