Thread 'News on Project Outages'

Message boards : Projects : News on Project Outages
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 13 · Next

AuthorMessage
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 34731 - Posted: 18 Sep 2010, 16:38:33 UTC - in response to Message 34728.  

Dnetc remains offline (it is now mid afternoon in Poland where they are located).

While this is an announced maintenance to upgrade their storage system to RAID 5, it is possible that either the upgrade process is taking longer than they had hoped or that they encountered problems similar to those which they saw when they performed a software upgrade a couple of weeks ago.
ID: 34731 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 34747 - Posted: 19 Sep 2010, 15:18:23 UTC - in response to Message 34731.  

The folks at Dnetc are struggling to recover from their latest upgrade efforts.

It seems, just as happened during their software upgrade two weeks ago, some unexpected event occurred in the middle of this weeks hardware upgrade to RAID 5.

Their site has been totally offline for the past 36 hours. Sometime yesterday, they got to a point where their homepage had the simple phrase 'It Works!' - they used that phrase during some of their software upgrade problems as they were trying to recovery. Then their site went dark for another 18 hours. Today, we are presented with a new phrase - which suggests a level of frustration as they try to get things going. The total content of their home page (translated to English):

Theory - is when you know everything, but nothing works.

Practice - is when everything works but nobody knows why.

Here we combine theory and practice - nothing works and nobody knows why!


The original Polish:

Teoria - to kiedy wiecie wszystko, lecz nic nie pracuje.

Praktyka - to kiedy wszystko pracuje, lecz nikt nie wie dlaczego.

W tym miejscu laczymy teorie i praktyke - nic nie pracuje i nikt nie wie dlaczego!


I do hope they are able to recover from this upgrade soon.
ID: 34747 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 34752 - Posted: 19 Sep 2010, 20:17:53 UTC - in response to Message 34747.  

The Dnetc folks are getting a bit further with their recovery efforts.

Home page report now:


Warning: mysql_pconnect() [function.mysql-pconnect]: Access denied for user 'dnetc'@'localhost' (using password: NO) in /home/serwer/projects/dnetc/html/inc/db.inc on line 39
Unable to connect to database - please try again later Error: 1045Access denied for user 'dnetc'@'localhost' (using password: NO)
ID: 34752 · Report as offensive
sygopet

Send message
Joined: 9 Mar 06
Posts: 12
United Kingdom
Message 34924 - Posted: 25 Sep 2010, 13:10:40 UTC
Last modified: 25 Sep 2010, 13:14:07 UTC

From SETI front page
Our upload (results) storage area is full. The project is down until we resolve this
25 Sep 2010 7:57:24 UTC

ID: 34924 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15567
Netherlands
Message 34947 - Posted: 25 Sep 2010, 22:22:58 UTC - in response to Message 34924.  
Last modified: 25 Sep 2010, 22:24:41 UTC

Posted by Jeff Cob, Seti admin:

Reality got a little ahead of us on this one. We were days, a week tops, away from migrating upload service from bruno to bambi. This will double our upload space and allow us to turn off bruno.

We will now move this up and make it top priority come Monday. We need to reconfigure the raid on bambi and then let the raid sync. At that point we can both turn the projects on and start migrating the results from bruno to bambi. We hope that this will be early in the week. We'll then leave the projects on through next weekend, ie no normal 3 day outage.
ID: 34947 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 34967 - Posted: 26 Sep 2010, 18:06:26 UTC

Aqua is offline -- 'disk full' -- possibly a result of their newer batch of much smaller work units clogging things up a lot faster than they anticipated.
ID: 34967 · Report as offensive
JHPArizona

Send message
Joined: 20 Feb 09
Posts: 10
United States
Message 34968 - Posted: 26 Sep 2010, 19:14:05 UTC

Enigma seems to be up but all my computers report it as off-line:
9/26/2010 11:37:05 AM Project communication failed: attempting access to reference site
9/26/2010 11:37:10 AM Internet access OK - project servers may be temporarily down.

JHPArizona
ID: 34968 · Report as offensive
JHPArizona

Send message
Joined: 20 Feb 09
Posts: 10
United States
Message 34969 - Posted: 26 Sep 2010, 19:19:30 UTC

I have lots of results ready to report to SETI and SETI Beta but the project is still down. Website is up but with only the header and this message:
Unable to connect to database - please try again later Error: 2003Can't connect to MySQL server on 'mork' (4)

The only good thing is they seem to 'REALLY' extended the due dates as most are due in Nov and even the Oct WU that is done isn't due until 10/26

JHPArizona
ID: 34969 · Report as offensive
JHPArizona

Send message
Joined: 20 Feb 09
Posts: 10
United States
Message 34970 - Posted: 26 Sep 2010, 19:24:29 UTC

Einstein status page shows all is good but I have not been able to communicate with the project since 9/25.

Anybody else having problems with Einstein@Home?

JHPArizona
ID: 34970 · Report as offensive
ProfileGundolf Jahn

Send message
Joined: 20 Dec 07
Posts: 1069
Germany
Message 34972 - Posted: 26 Sep 2010, 19:27:23 UTC - in response to Message 34970.  

Anybody else having problems with Einstein@Home?

No problems here:
26/09/2010 12:13:02|Einstein@Home|[sched_op_debug] Starting scheduler request
26/09/2010 12:13:02|Einstein@Home|Sending scheduler request: Requested by user.  Requesting 0 seconds of work, reporting 1 completed tasks
26/09/2010 12:13:08|Einstein@Home|Scheduler request succeeded: got 0 new tasks

Perhaps your problems with Enigma are the same?

Gruß,
Gundolf
ID: 34972 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15567
Netherlands
Message 34973 - Posted: 26 Sep 2010, 20:22:31 UTC - in response to Message 34947.  

Seti update:

Perhaps they started work on their migration to other servers early, as since some hours all you'll get is:

Project is down
The project's database server is down. Please check back in a few hours.
ID: 34973 · Report as offensive
ProfileGary Charpentier
Avatar

Send message
Joined: 23 Feb 08
Posts: 2495
United States
Message 34975 - Posted: 26 Sep 2010, 20:55:36 UTC

SETI@home
Unable to connect to database - please try again later Error: 2013Lost connection to MySQL server at 'reading initial communication packet', system error: 113

Also

SETI@home/AstroPulse Beta
Unable to connect to database - please try again later Error: 2013Lost connection to MySQL server at 'reading initial communication packet', system error: 113


ID: 34975 · Report as offensive
JHPArizona

Send message
Joined: 20 Feb 09
Posts: 10
United States
Message 34976 - Posted: 26 Sep 2010, 22:52:59 UTC - in response to Message 34972.  
Last modified: 26 Sep 2010, 22:55:28 UTC

Anybody else having problems with Einstein@Home?


No problems here:
26/09/2010 12:13:02|Einstein@Home|[sched_op_debug] Starting scheduler request
26/09/2010 12:13:02|Einstein@Home|Sending scheduler request: Requested by user. Requesting 0 seconds of work, reporting 1 completed tasks
26/09/2010 12:13:08|Einstein@Home|Scheduler request succeeded: got 0 new tasks

Perhaps your problems with Enigma are the same?
Well.... If it were only one of my computers I would believe it to be a problem on my side. Since it is all of my home computers (3) I find it harder to believe all three of them suddenly developed a problem. Here is the listing from my Linux box:
Sun 26 Sep 2010 11:23:48 AM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 11:23:50 AM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 11:24:52 AM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 11:24:53 AM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 11:26:01 AM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 11:26:03 AM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 11:27:03 AM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 11:27:09 AM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 11:29:22 AM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 11:29:25 AM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 11:35:10 AM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 11:35:12 AM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 11:39:46 AM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 11:39:48 AM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 11:52:18 AM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 11:52:22 AM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 11:55:29 AM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 11:55:33 AM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 01:10:21 PM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 01:10:23 PM MST Internet access OK - project servers may be temporarily down.
Sun 26 Sep 2010 01:27:54 PM MST Project communication failed: attempting access to reference site
Sun 26 Sep 2010 01:27:56 PM MST Internet access OK - project servers may be temporarily down.

Similar responses from my other 2 boxes (Windows and OS X)

Enigma on the other hand has unclogged and uploaded WUs and downloaded new ones.

JHPArizona
ID: 34976 · Report as offensive
JHPArizona

Send message
Joined: 20 Feb 09
Posts: 10
United States
Message 34982 - Posted: 27 Sep 2010, 6:50:01 UTC - in response to Message 34976.  

Well things are improving at SETI :^)
The status page is up but Mork is still disabled so the database is not available.

JHPArizona
ID: 34982 · Report as offensive
ProfileGundolf Jahn

Send message
Joined: 20 Dec 07
Posts: 1069
Germany
Message 34983 - Posted: 27 Sep 2010, 7:25:25 UTC - in response to Message 34976.  

Well.... If it were only one of my computers I would believe it to be a problem on my side.

But since it doesn't happen to other users, it seems to be at your side anyway. Perhaps your ISP? To get more information, turn on some debug flags in cc_config.xml.

And since this is obviously not about a project outage, please start a new thread if you have any more questions.

Gruß,
Gundolf
ID: 34983 · Report as offensive
JHPArizona

Send message
Joined: 20 Feb 09
Posts: 10
United States
Message 34986 - Posted: 27 Sep 2010, 14:17:42 UTC - in response to Message 34983.  

Thanks, I did not know that I could set debug flags in cc_config.XML. I have taken a look at http://boinc.berkeley.edu/wiki/Client_configuration and will see what I can find. And yes, this will be the last post on this issue as I did get a bit OT with it. My computers have all made contact with Einstein@home so ..... maybe it was a problem with my ISP..... would not be the first time they blocked something on me without warning.....

JHPArizona
ID: 34986 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15567
Netherlands
Message 35001 - Posted: 28 Sep 2010, 20:55:36 UTC

This thread is for reporting project outages only. If you want help on any problem, please start your own thread, or find a thread that's dealing with your problem already and add to it.

As for posting your email address, don't! These forums are read by spy-bots, which just like to gather information like that and send you all kinds of spam. Don't post your account keys for your projects either, nor your telephone number.

These forums are manned by volunteers. We're not going to email you or phone you.

Again, this thread is for reporting project outages, not to ask for help. Please be kind and post your requests for help anywhere else on this forum. Sub-forums enough.
ID: 35001 · Report as offensive
Sven

Send message
Joined: 29 Sep 10
Posts: 1
United States
Message 35006 - Posted: 29 Sep 2010, 12:20:14 UTC

Is there an issue with SETI@home servers? They seem to have been down more then a day.
ID: 35006 · Report as offensive
MarkJ
Volunteer tester
Help desk expert

Send message
Joined: 5 Mar 08
Posts: 272
Australia
Message 35007 - Posted: 29 Sep 2010, 13:12:58 UTC - in response to Message 34976.  

Anybody else having problems with Einstein@Home?


Yep.

Web site was down before but now back up. According to server status page the scheduler was off and most of the wu generators (29Sep2010 at 12:45 UTC). Checking just now (13:00 UTC) it seems most of it is back on-line apart from ABP wu generators.
ID: 35007 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 35008 - Posted: 29 Sep 2010, 13:43:36 UTC

Dnetc is offline -- they went totally offline about 11 hours ago -- no home page, no server access. It may be due to a software upgrade they were planning -- hardware and software upgrades for them often keep them offline for 2 to 4 days for some reason.

To the person asking about SETI -- they ran out of disk space earlier than they had anticipated so they are in the process of expanding and rebuilding their RAID array and relocating various resources between their several servers. The last status report they offered (over the weekend) was that they hope to be up early this week -- perhaps that was a tad optimistic.
ID: 35008 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 13 · Next

Message boards : Projects : News on Project Outages

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.