Message boards : Projects : News on Project Outages
Message board moderation
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 13 · Next
Author | Message |
---|---|
Send message Joined: 4 Sep 09 Posts: 381 |
The Climate disk full scenario seems to be moving to chronic -- are there any plans for moving forward from this so that Milo doesn't have to semi-regularly shut down and move data around for a temporary solution. |
Send message Joined: 4 Sep 09 Posts: 381 |
I am guessing that the problems at SETI won't be looked at until Monday, and then at best won't be resolved until it is time for the weekly half-week shutdown, meaning that SETI is not going to be available for uploads/downloads until Friday this coming week, at which time the accumulated traffic jam may make things difficult for a period of days. The thing is, the current 'half-week on/half-week off' cycle means that any problems that occur during the 'half-week on' phase become quite a bit more disruptive for SETI. |
Send message Joined: 4 Sep 09 Posts: 381 |
The periodic validator/work generator memory leak bug has resurfaced for Milkyway -- no new work, completed work not getting validated. Probably will be resolved by Monday noon. |
Send message Joined: 29 Aug 05 Posts: 15542 |
I am guessing that the problems at SETI won't be looked at until Monday, and then at best won't be resolved until it is time for the weekly half-week shutdown, meaning that SETI is not going to be available for uploads/downloads until Friday this coming week, at which time the accumulated traffic jam may make things difficult for a period of days. Yeah, I'll wait till Tuesday before deciding if I am going to abort the 68 tasks in perpetual download/cannot download cycle. Too bad it'll reduce my next week's allowance to 30 tasks. ;-) |
Send message Joined: 24 Aug 09 Posts: 91 |
SETI is now totally offline. The main webpage was online earlier today. I guess things are worse than originally thought. |
Send message Joined: 23 Feb 08 Posts: 2486 |
SETI is now totally offline. The main webpage was online earlier today. I guess things are worse than originally thought. thinman is there answering pings and traceroute, but it looks like apache is not running. Don't know if it was disabled by hand or if drives went offline due to heat damage. In any case we know the project isn't coming up until the A/C repairman has finished. Hope he didn't need parts and has to order parts Monday AM then wait for a shipment from a supplier. |
Send message Joined: 4 Sep 09 Posts: 381 |
If memory serves, this is at least the second time in the past few years that the SETI project has had an AC failure in their server closet. One may hope that from this they are able to implement physical changes that improve the reliability of their cooling there and perhaps provide amore adequate closet layout (that is perhaps they have too much equipment in a too small space to begin with). With their half week weekly offline schedule, it may well be until the end of this week that we see things back to 'normal' (once they are fully online, a week long outage is going to show up with major traffic jams (upload/download) which may take over a day to sort out. SETI is now totally offline. The main webpage was online earlier today. I guess things are worse than originally thought. |
Send message Joined: 30 Aug 05 Posts: 505 |
SETI@home _ Server status page _ Just for info nothing yet as of this post. Give Matt and crew time to do their thing. |
Send message Joined: 23 Feb 08 Posts: 2486 |
SETI update Monday Update: The air conditioning in our server closet failed on Saturday, causing several of our important systems to overheat. Most servers and services were shut down and will remain down as we continue to wait for the air conditioning to be fixed, which will be Tuesday at the earliest. Looks like they (Berkeley) did need to order parts. |
Send message Joined: 13 Aug 06 Posts: 778 |
CPDN main project Upload server climateapps1.oucs is now up and running though Milo may need to disable it later today for a short update. There is no need to take action. |
Send message Joined: 4 Sep 09 Posts: 381 |
Dnet went offline about 2 hours ago (7AM PDT) -- home page can't be reached. SETI remains offline (at a guess it will remain offline for the week). |
Send message Joined: 9 Mar 06 Posts: 12 |
Seti update, Tuesday 16:24 UTC Most servers and services were shut down and will remain down as we continue to wait for the air conditioning to be fixed, which will be Tuesday at the earliest. Looks like Friday at the earliest to me, if the usual midweek shutdown is included! |
Send message Joined: 24 Aug 09 Posts: 91 |
Seti update, Tuesday 16:24 UTC small parts came online today. Looks like they are allowing interrupted wu to download. However it looks like full restore will be delayed until after the midweek shutdown passes. |
Send message Joined: 23 Feb 08 Posts: 2486 |
Seti Update Air Conditioning Update (Tuesday): The air conditioning in our server closet failed on Saturday, causing several of our important systems to overheat. Most servers and services were shut down to prevent damage and remained down until the air conditioner was finally checked out Monday afternoon. We tested the system under full load this morning and it failed again, so full production is delayed at least another day. Sorry for the confusion/inconvenience. Not looking good. |
Send message Joined: 30 Aug 05 Posts: 505 |
SETI@home Update _ Wednesday _ 15 Sep 2010 17:17:53 UTC 15 Sep 2010 17:17:53 UTC SETI@home _ Server status page SETI@home _ Message boards _ appear to be back as of this posting. |
Send message Joined: 24 Aug 09 Posts: 91 |
Looks like seti is down till tomorrow. The web site is offline again. They did tell us that it may die again as final repairs had not been made. |
Send message Joined: 23 Feb 08 Posts: 2486 |
SETI http://setiathome.berkeley.edu/forum_thread.php?id=61442&nowrap=true#1033202 Jeff Cobb writes: We're taking the project off line for the night, partly (mostly) for temperature concerns, but also to let the back end queues drain and give more I/O to the thumper root mirror re-sync that became necessary. |
Send message Joined: 29 Aug 05 Posts: 15542 |
Seti@Home Update: Jeff Cobb wrote: OK then, I think we may be up. The condenser fan motor was replaced today and we brought the projects up. It's good that we can test under load while we're still at the lab. |
Send message Joined: 4 Sep 09 Posts: 381 |
Dnetc is currently offline -- they are performing a hardware upgrade (moving up to a RAID 5 array). They had shorter outages during the week as they got the hardware physically installed. I'm guessing the current outage is the 'big one' for them -- they have been offline for about 10 hours so far. This is a planned outage though -- it was announced on the homepage as September 14 to September 18. |
Send message Joined: 29 Aug 05 Posts: 15542 |
Looks like Orbit@Home bit the dust already. From "In production" to "down" in two days. Must be a BOINC record. :) |
Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document
under the terms of the GNU Free Documentation License,
Version 1.2 or any later version published by the Free Software Foundation.