News on project outages

Message boards : Projects : News on project outages
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next

AuthorMessage
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 33160 - Posted: 31 May 2010, 15:05:58 UTC - in response to Message 33154.  


Good news, I wish them luck on their endeavor -- the site is offline at the moment (8AM PDT).

Spinhenge is back online.

In keeping with the 'holiday outages theme' though, in addition to Einstein, SETI is offline again, and has now been joined by MilkyWay and Dnetc.

All in all, a rather dismal weekend in BOINC land.

The Einstein problem is that the filesystem server has filled up again. The admin there has taken time off of their free day to go fix it as well. Thank you, David. :-)

ID: 33160 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 33161 - Posted: 31 May 2010, 16:23:22 UTC - in response to Message 33160.  

DNetC is back up -- good news there.

MW, SETI and Einstein remain unreachable.

It is the holiday weekend, so I suspect that SETI and MW will remain offline until tomorrow (when SETI goes back offline for maintenance -- though the positive effect of weekly 6 hour offline maintenance for SETI *appears* to be limited.

It is possible that the disk space problems that surprised Einstein this weekend are severe enough to cause a more extensive outage there. I do recall they have had disk space over-runs in the past....

As to MW -- they have been pretty reliable for a while, so I guess they were due for an outage.

ID: 33161 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14824
Netherlands
Message 33162 - Posted: 31 May 2010, 17:47:31 UTC

Einstein@Home is back.

May 31, 2010
One of the E@H servers ran out of space on it's filesystem and the project was offline for nearly 12 hours. E@H is running again and should be back to normal soon.
ID: 33162 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 33163 - Posted: 31 May 2010, 18:21:57 UTC - in response to Message 33162.  

Indeed -- good for them -- coming in over the holiday weekend to get things going.

So for me, the two offline projects remain SETI -- and I suspect this week, like last week is going to be a difficult one for them, and MilkyWay -- which likely won't come back online until sometime tomorrow.

Einstein@Home is back.

May 31, 2010
One of the E@H servers ran out of space on it's filesystem and the project was offline for nearly 12 hours. E@H is running again and should be back to normal soon.

ID: 33163 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 33165 - Posted: 31 May 2010, 19:08:55 UTC - in response to Message 33163.  

The holiday weekend madness seems to be continuing.

DnetC is coping with server issues (particularly the scheduler). They are working on it.

Collatz appears to be coping with their service provider (I believe that would be ComNotCast).

MW and SETI remain out.
ID: 33165 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14824
Netherlands
Message 33166 - Posted: 31 May 2010, 21:02:16 UTC - in response to Message 33165.  
Last modified: 31 May 2010, 21:28:35 UTC

Something seems to be happening at Seti. I've uploaded my work that had been waiting most of the day for something to happen. Reporting is out of the question, there's no scheduler. No web pages either.

Edit: web pages and forums are back. Scheduler is also up&running. I just reported my work.
ID: 33166 · Report as offensive
Bernd

Send message
Joined: 24 Aug 09
Posts: 91
United States
Message 33171 - Posted: 31 May 2010, 23:32:56 UTC - in response to Message 33166.  

Something seems to be happening at Seti. I've uploaded my work that had been waiting most of the day for something to happen. Reporting is out of the question, there's no scheduler. No web pages either.

Edit: web pages and forums are back. Scheduler is also up&running. I just reported my work.


Good news is it all seems to be online. The only bad news is all the data to crunch is 2 tapes that are almost done. So the next time things drop it maybe because the work ran out. Cricket graph is showing a lot of inbound and outbound web traffic. When out bound drops and inbound stays up we will have run out of work.
ID: 33171 · Report as offensive
Ralph

Send message
Joined: 30 Sep 05
Posts: 50
Message 33172 - Posted: 31 May 2010, 23:45:41 UTC

and Milkyway goes down again.

The site also seems to be "unavailable" as of about 10:45 EDT this morning.

"
31/05/2010 10:43:47 AM Milkyway@home Started upload of de_new_test2_275024_1275168645_1_0
31/05/2010 10:44:09 AM Project communication failed: attempting access to reference site
31/05/2010 10:44:09 AM Milkyway@home Temporarily failed upload of de_new_test2_275024_1275168645_1_0: connect() failed
31/05/2010 10:44:09 AM Milkyway@home Backing off 1 min 0 sec on upload of de_new_test2_275024_1275168645_1_0
31/05/2010 10:44:10 AM Internet access OK - project servers may be temporarily down.
31/05/2010 10:45:09 AM Milkyway@home Started upload of de_new_test2_275024_1275168645_1_0
31/05/2010 10:45:32 AM Project communication failed: attempting access to reference site
31/05/2010 10:45:32 AM Milkyway@home Temporarily failed upload of de_new_test2_275024_1275168645_1_0: connect() failed
31/05/2010 10:45:32 AM Milkyway@home Backing off 1 min 0 sec on upload of de_new_test2_275024_1275168645_1_0
"
ID: 33172 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14824
Netherlands
Message 33173 - Posted: 1 Jun 2010, 7:52:41 UTC

Seti forums are down again. Everything else is (so far) available.
ID: 33173 · Report as offensive
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 4677
United Kingdom
Message 33181 - Posted: 1 Jun 2010, 13:41:33 UTC

http://boinc.netsoft-online.com seems to be down.

That's the site which provides the cross-project stats listing of other projects on your account page, on every BOINC project. It's causing account pages to load extremely slowly, even on projects which aren't having any problems of their own.
ID: 33181 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14824
Netherlands
Message 33189 - Posted: 1 Jun 2010, 15:55:23 UTC - in response to Message 33181.  

Einstein has additional load due to maintenance.

David Hammer wrote:
There is a lot of work being done on Einstein right now and that is why it is slow. In particular I am moving data from one server to another to free up space.
ID: 33189 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 33192 - Posted: 1 Jun 2010, 16:57:13 UTC - in response to Message 33173.  

Right, MW went back up early this morning and all other sites (for me anyway) aside from SETI appear to be running.

As for SETI -- I suppose we can hope that June is a better month (though the start of June is not the best of harbingers). I think this is one of the longer total offline runs (not even a home page is accessible) for SETI in its checkered history.

Seti forums are down again. Everything else is (so far) available.

ID: 33192 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14824
Netherlands
Message 33193 - Posted: 1 Jun 2010, 17:29:47 UTC - in response to Message 33192.  
Last modified: 1 Jun 2010, 17:29:58 UTC

As for SETI -- I suppose we can hope that June is a better month (though the start of June is not the best of harbingers). I think this is one of the longer total offline runs (not even a home page is accessible) for SETI in its checkered history.

They do have their weekly outage at this time, So I don't expect anything from them in the next 4 to 6 hours.
ID: 33193 · Report as offensive
Ralph

Send message
Joined: 30 Sep 05
Posts: 50
Message 33197 - Posted: 1 Jun 2010, 18:30:47 UTC

...and Milkyway's up again!

ID: 33197 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 33198 - Posted: 1 Jun 2010, 19:26:46 UTC - in response to Message 33193.  

Regarding SETI, understood, they have their Tuesday 4 to 6 hour outage going on right now (they got their website up just in time for that). In the best of times, that 4 to 6 hour outage is followed by several hours of 'traffic jam' joy. With the weekend outage and the backlog it has generated, it may well be into Wednesday afternoon before things actually settle down there, and that is assuming that the root causes for the weekend outage are resolved.

As for SETI -- I suppose we can hope that June is a better month (though the start of June is not the best of harbingers). I think this is one of the longer total offline runs (not even a home page is accessible) for SETI in its checkered history.

They do have their weekly outage at this time, So I don't expect anything from them in the next 4 to 6 hours.

ID: 33198 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14824
Netherlands
Message 33200 - Posted: 1 Jun 2010, 22:32:10 UTC - in response to Message 33198.  

Seti's back, including forums. Bets are open for how long, though. :-)
ID: 33200 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14824
Netherlands
Message 33218 - Posted: 2 Jun 2010, 17:31:57 UTC

ClimatePrediction.Net joined the outage foray. :-)

milo wrote:
We're having to undertake some database maintenance and so there may be a loss of service from climateapps2 (the BOINC scheduler) this afternoon. We apologise for the inconvenience.
ID: 33218 · Report as offensive
Profile Byron Leigh Hatch @ team Carl ...
Avatar

Send message
Joined: 30 Aug 05
Posts: 505
Canada
Message 33219 - Posted: 2 Jun 2010, 17:32:00 UTC

ClimatePrediction.net Project down for maintenance
ID: 33219 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 33224 - Posted: 2 Jun 2010, 20:26:59 UTC

Collatz went offline about 4 hours ago (9:30AM PDT) -- still offline -- no access at all. Might be their ISP (that's what was behind an 18 hour outage last Friday).
ID: 33224 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14824
Netherlands
Message 33233 - Posted: 2 Jun 2010, 22:21:02 UTC

The outage at ClimatePrediction.net will last through the night. This is due to a BOINC back-end update that's not going according to plans and the admins there needing some well-earned sleep.
ID: 33233 · Report as offensive
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next

Message boards : Projects : News on project outages

Copyright © 2022 University of California. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.