News on project outages.

Message boards : Projects : News on project outages.
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 10 · 11 · 12 · 13 · 14 · 15 · Next

AuthorMessage
Heidi1
Avatar

Send message
Joined: 30 Mar 08
Posts: 18
United States
Message 27447 - Posted: 16 Sep 2009, 17:39:26 UTC

I think Rosetta is down. I can't get access to their site, nor can my GPU communicate with their server.
ID: 27447 · Report as offensive
Robert

Send message
Joined: 16 Sep 09
Posts: 1
United States
Message 27448 - Posted: 16 Sep 2009, 17:52:15 UTC - in response to Message 27447.  

I think Rosetta is down. I can't get access to their site, nor can my GPU communicate with their server.


Exact same issue here. Just waiting it out.
ID: 27448 · Report as offensive
ZPM
Avatar

Send message
Joined: 14 Mar 09
Posts: 215
United States
Message 27449 - Posted: 16 Sep 2009, 18:44:53 UTC - in response to Message 27447.  

GPU


did i miss something or did you just mean to put cpu?
ID: 27449 · Report as offensive
ZPM
Avatar

Send message
Joined: 14 Mar 09
Posts: 215
United States
Message 27612 - Posted: 26 Sep 2009, 19:33:44 UTC - in response to Message 27449.  

collatz, off line, site not responding and server seems to be lost.
ID: 27612 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14770
Netherlands
Message 27615 - Posted: 26 Sep 2009, 20:57:46 UTC - in response to Message 27612.  

Collatz is back up, they have concluded their server maintenance.

Database maintenance complete
September 26, 15:18 CST
I planned on notifying everyone today that the project would be down tomorrow for some planned database maintenance, but since Comcast was kind enough to drop the network line for a couple hours today, I took advantage of the network outage and got the maintenance done at the same time.
ID: 27615 · Report as offensive
Profile Gundolf Jahn

Send message
Joined: 20 Dec 07
Posts: 1069
Germany
Message 27737 - Posted: 3 Oct 2009, 10:29:55 UTC
Last modified: 3 Oct 2009, 11:10:34 UTC

SETI@home

Since about 3:00 local time (10:00 UTC) the BOINC master database is disabled. So, uploading is possible, but no reporting or downloading (scheduler needs database). The forum is inaccessible too.

Gruß,
Gundolf
03/10/2009 10:27:04|SETI@home|Sending scheduler request: To fetch work.  Requesting 2041 seconds of work, reporting 1 completed tasks
03/10/2009 10:29:19|SETI@home|Scheduler request succeeded: got 0 new tasks
03/10/2009 10:29:19|SETI@home|[sched_ops_debug] Server version 611
03/10/2009 10:29:19|SETI@home|Message from server: Server can't open database
03/10/2009 10:29:19|SETI@home|Project requested delay of 3600.000000 seconds
03/10/2009 10:29:19|SETI@home|[sched_op_debug] Deferring communication for 1 hr 0 min 0 sec
03/10/2009 10:29:19|SETI@home|[sched_op_debug] Reason: project is down
ID: 27737 · Report as offensive
Nicolas

Send message
Joined: 19 Jan 07
Posts: 1179
Argentina
Message 27742 - Posted: 3 Oct 2009, 20:25:19 UTC - in response to Message 27737.  

SETI@home

Since about 3:00 local time (10:00 UTC) the BOINC master database is disabled. So, uploading is possible, but no reporting or downloading (scheduler needs database). The forum is inaccessible too.

Eric Korpela reports:
"Our database machine crashed. I can't get in to campus. Matt's nowhere to be found. Jeff's in Nepal. Dan's in South Africa. Please spread the word that we know that there's a problem."

ID: 27742 · Report as offensive
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 4639
United Kingdom
Message 27744 - Posted: 4 Oct 2009, 0:06:27 UTC

SETI@home seems to be back (they must have rescued Matt from under that server), but things will be slow and flakey for a while.
ID: 27744 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 27749 - Posted: 4 Oct 2009, 7:10:38 UTC

Looks like Einstein is offline for now (midnight PDT)
ID: 27749 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14770
Netherlands
Message 27752 - Posted: 4 Oct 2009, 8:34:30 UTC

Einstein has recovered and is available again.
ID: 27752 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14770
Netherlands
Message 27758 - Posted: 4 Oct 2009, 12:21:59 UTC

It looks like Seti@Home bit the dust once more.
ID: 27758 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 27770 - Posted: 4 Oct 2009, 17:52:55 UTC - in response to Message 27758.  

Seems that way for both of the oldies.


It looks like Seti@Home bit the dust once more.

ID: 27770 · Report as offensive
ScarabDrowner

Send message
Joined: 14 Jul 09
Posts: 3
United States
Message 27772 - Posted: 5 Oct 2009, 2:36:51 UTC

SETI's page is once again available, but the majority of their servers are still down and not even appearing on the status page.
ID: 27772 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14770
Netherlands
Message 27783 - Posted: 5 Oct 2009, 21:00:30 UTC

Seti is back.

Matt Lebofsky wrote:
Okay that was an ugly weekend. On Saturday morning I came to realize that our master mysql database server (mork) had crashed. I was the only one available at the time so I came up to the lab and rebooted the thing. We really need to improve our remote kvm/power cycle situation. I babysat the reboot long enough to see that mysql was recovering, knowing though that the replica would be out of sync (and need to be regenerated from scratch during the next weekly backup).

But then everything else crashed, and also hard enough to require human intervention. This time Eric eventually came up on Sunday to try to reboot a series of servers, but to no avail - they kept locking up shortly after reboot.

So Monday morning (today) we came into the lab and started cleaning up the server situation. Eric finally found the cause of the latter, if not all, of our problems. We have a pseudo user account is the "user" that runs a lot of stuff, apache processes, cron jobs, some of the BOINC back end servers, etc. For some reason the .history file had grown to 8GB in size, and it was full of garbage. Not sure why just yet, but that meant every time one of the above processes started, the shell tried to read in this impossibly large history file. Oops. Once Eric deleted this file all these dams broke free and we were able to safely recover all the databases/etc. throughout our long morning.

- Matt
ID: 27783 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 27944 - Posted: 12 Oct 2009, 21:46:07 UTC

Einstein is offline as of this afternoon (2PM PDT). They have had some rather troublesome outages over the past couple of months, hope this isn't another one of those.
ID: 27944 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 27947 - Posted: 12 Oct 2009, 22:52:19 UTC - in response to Message 27944.  

Looks like Einstein is back up again -- though it seems that the validator might be stalled.
ID: 27947 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14770
Netherlands
Message 27984 - Posted: 13 Oct 2009, 21:45:54 UTC

DrugDiscovery@Home.com will be down while Jack moves the project to a new server.
ID: 27984 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14770
Netherlands
Message 27992 - Posted: 14 Oct 2009, 11:08:42 UTC - in response to Message 27984.  

The move to the IronScale server went without too many flaws, DrugDiscovery@Home.com is back.
ID: 27992 · Report as offensive
Profile Jord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 14770
Netherlands
Message 28004 - Posted: 14 Oct 2009, 15:07:39 UTC

Jack was in the process of updating the Hydrogen project as well, when he made an error with the MySQL database, effectively deleting the Hydrogen project. He is trying to get it back, else he'll have to put back an old backup from July.
ID: 28004 · Report as offensive
ZPM
Avatar

Send message
Joined: 14 Mar 09
Posts: 215
United States
Message 28080 - Posted: 17 Oct 2009, 23:25:26 UTC - in response to Message 28004.  
Last modified: 17 Oct 2009, 23:27:15 UTC

COLLATZ website non-responsive. uploads seem to work, and reporting but slow.

ok, good luck with this one, responds after 3 minutes the website does...

sort of an up/down/slow responses..
ID: 28080 · Report as offensive
Previous · 1 . . . 10 · 11 · 12 · 13 · 14 · 15 · Next

Message boards : Projects : News on project outages.

Copyright © 2021 University of California. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.