It looks like Einstein@Home just got problems with their database. All it says is "Unable to connect to database - please try again later Error: 1040Too many connections" on their main page.

We'll wait for them to return.

Edit: talk about service. They're back already. ;-)

CPDN main project

A member has just reported the following BOINC Manager messages when trying to upload a CPDN model zip file:

01/03/2009 09:43:49|climateprediction.net|[error] Error reported by file upload server: can't write file /storage/incoming/uploader/hadcm3istd_cpbk_1920_160_06016948_6_1.zip: No space left on server

01/03/2009 09:43:49|climateprediction.net|Backing off 24 min 16 sec on upload of hadcm3istd_cpbk_1920_160_06016948_6_1.zip

The disk of one of the CPDN upload servers must be full. Milo now knows about the problem but doesn't yet know which upload server is affected. He will probably not be able to solve the problem immediately as he will need to move data to another disk.

As there are several upload servers, this will affect file uploads from some models but not others. If you receive the same or similar messages when trying to upload a model file, please suspend BOINC network activity for the time being to avoid repeated failed upload attempts. We realise that multi-project crunchers may not be able to do this for long periods.

Trickle uploads should not be affected.

CPDN main project - update to previous post.

Milo says 'Climateapps3.oucs is the culprit. This will mean moving around 500GB of files off to wyrm.oerc, which is itself 94% full and has only about 700GB free. I've set this job going and hopefully it will finish by tomorrow, at which point I will turn climateapps3.oucs back on again.'

The CPDN server status page now shows climateapps3.oucs down. When it's up and running again it should accept model file uploads.

CPDN upload server climateapps3.oucs is up and running.

CPDN Beta Project

The Beta server is down. The forum cannot be accessed. Uploads of trickles and files fail as well as the reporting of completed models. Milo or Tolu will be investigating the problem on Saturday.

CPDN Beta Project

The server is now partially active. The forum is back online and zip files can be uploaded. But trickles cannot be sent and completed models cannot be reported.

CPDN main project

Tolu has taken down at least one CPDN server, climateapps2, while he generates more workunits. At the moment at least some members' trickle-ups are failing and there's no CPDN-BOINC forum. It would be a good idea to suspend BOINC network activity temporarily if you can.

CPDN main project

The CPDN server programs are coming back up. The CPDN forum and other data-driven web pages are back but some computers still can't upload trickles.

CPDN credits haven't updated today so they can't be exported to the stats sites. They should catch up tomorrow.

CPDN Beta project

Beta credits haven't been transferred to members' CPDN accounts for about two weeks. Milo says a firewall restriction sprang up between the two machines. This is now fixed but the transfer script won't run immediately. Thanks to Beta crunchers for your patience in this respect.

CPDN main project server climateapps2 is down again. There's no access to the website or CPDN-BOINC forum and trickles from at least some computers are failing.

The CPDN Beta server is partially down with the website and forum inaccessible. But it is accepting trickles.

I seem to post here more regularly about server problems than many other projects. But CPDN and its subprojects in fact have a good record of server uptime compared with other BOINC projects.

Does anyone have any news about Cosmology@home? They had a power failure last weekend, came back up but then circled the drain all week. Now everything is offline, including their website.

Does anyone have any news about Cosmology@home? They had a power failure last weekend, came back up but then circled the drain all week. Now everything is offline, including their website.

Good question. There's been no contact or news for a week.

---

i just joined cosmo. and it goes compute this = were sry, the site you have reached is currently getting an oil job. please try again.

The servers for the CPDN main project and CPDN Beta are all working properly again.

Beta members' credits are now being transferred to CPDN and exported to the stats sites.

from Cosmology in my Cache:
The Cosmology@home server has been suffering abnormal crashes ever few hours since the campus power outage on March 8, 2009. We will be taking to server ...

Thats now 7 Days ago, looks they have massive Problems

Just got an answer from Ben Wandelt. No real news about Cosmo, but at least Anshul is looking into the problem...

"Ben Wandelt" wrote:

Re: Cosmo@home down

Thanks stefan

I am out of town but anshul is looking into it. Probably a consequence of the massive power outage last weekend.

Ben

---

Better yet, I got lots of replies. ;-)

Ben Wandelt wrote:

Hi Jord

I am out of town. Anshul noticed that our server had intermittent problems starting after the massive power outage on the whole campus last Sunday. There were downed power lines after a storm. NCSA is still recovering from the aftermath. We were up almost immediately but now it seems we may have hardware damage. Anshul was looking at replacing parts but I have not heard from him since the beginning of the most recent outage.

So we are certainly aware of the problem but since I am at Caltech at the moment I cannot give you a detailed status update.

Ben

Anshul Kanakia wrote:

Hi Jord,
I had put up a new article on the website before it went down about Cosmo@home server maintenance. We started experiencing sporadic server crashes after the campus power failure so I took the server down. We are currently in the process of sending it out for maintenance to get the hardware checked. I think its most probably a hard drive failure - some sector that the OS tries to access that got locked or corrupted. We should be back up in 2 weeks at most. 2 weeks because next week is spring break on campus and I will not be around when the server gets back. Thanks for sending me this email. I was trying to figure out how to send a message to our users that we are down, and so is the website.

Anshul Kanakia

Scott Kruger wrote:

I will try to be here when the server gets back so we can get it up as soon as possible. I'll also see about getting a temporary website up.

-Scott

---

Seti@Home has no work at the moment. Their databases are off line, since they crashed earlier on Friday. It's being worked on.

Hydrogen has temporary server problems. It would seem that the work I made last night filled up the upload server and has now crashed the database.

I am sure though that Jack will be on it once he wakes up. To be continued.

Seti@Home has got their servers back online. Now they're being hammered by everyone. Work is available, but you have to have patience to get it.

Hydrogen's server has been back up since yesterday.