Thread 'News on project outages.'

Message boards : Projects : News on project outages.
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 15 · Next

AuthorMessage
mo.v
Avatar

Send message
Joined: 13 Aug 06
Posts: 778
United Kingdom
Message 22407 - Posted: 13 Jan 2009, 4:42:42 UTC

CPDN Main Project

Uploader1.atm is currently down for maintenance and will probably not be up again until late on Tuesday. This will affect uploads from some computers but not all.

CPDN server status

The independent forum will be down for a while on Tuesday from 10.00 UTC.
ID: 22407 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15549
Netherlands
Message 22439 - Posted: 14 Jan 2009, 18:17:17 UTC - in response to Message 22407.  

Can you tell Milo that not all is fixed?

This is what I get with every post on the new forums, including when trying to PM.
Ran into problems sending Mail. Response: 550 You are claiming to be smtp.ox.ac.uk but that's me!

DEBUG MODE

Line : 165
File : smtp.php


Also, the old boards lived at http://www.climateprediction.net/board/index.php ... the new ones dropped the www. part. But all links everywhere still point to the old address. Including here (2nd link).

There'll be a lot of broken links. ;)
ID: 22439 · Report as offensive
mo.v
Avatar

Send message
Joined: 13 Aug 06
Posts: 778
United Kingdom
Message 22493 - Posted: 17 Jan 2009, 0:18:40 UTC

CPDN main project

Milo thinks all the links to the independent forum are now fixed and working.

He says 'Uploader1.atm is still suffering from hardware problems and I will not be able to get at it again until Monday. The plan is to have it upgraded and back on line as early as possible next week.'

He can't get at this upload server because it's in a different building.
ID: 22493 · Report as offensive
mo.v
Avatar

Send message
Joined: 13 Aug 06
Posts: 778
United Kingdom
Message 22550 - Posted: 20 Jan 2009, 23:14:25 UTC

CPCN main project

Milo has got uploader1.atm upload server up and running again and CPDN server status is now all green.

ID: 22550 · Report as offensive
mo.v
Avatar

Send message
Joined: 13 Aug 06
Posts: 778
United Kingdom
Message 22572 - Posted: 21 Jan 2009, 14:52:34 UTC

CPDN all projects

Milo says

'Due to hardware problems we've had to move our PHP discussion board [the independent forum] from the Open University to Oxford University. Unfortunately, this change has resulted in some problems with the underlying database resulting in post corruption or registration problems for some users. We are working to fix these problems as quickly as possible but it will probably involve further outages for the next few days. Please bear with us whilst we perform this essential maintenance.
The BOINC board will remain functional during this time, and as a result of the maintenance we should be able to upgrade to phpBB version 3, which has various improved features.'

ID: 22572 · Report as offensive
ProfileKSMarksPsych
Avatar

Send message
Joined: 30 Oct 05
Posts: 1239
United States
Message 22613 - Posted: 23 Jan 2009, 11:46:33 UTC
Last modified: 23 Jan 2009, 11:46:44 UTC

QMC@Home


I just got an email back from one of the project admins.

Robert wrote:

Unfortunately we currently have some technical
problems, our raid system has some diffculties.

We hope to be back online within today ... I am currently trying to put
up a page that gives some information about it and Martin is trying to
fix the server.
ID: 22613 · Report as offensive
ProfileKSMarksPsych
Avatar

Send message
Joined: 30 Oct 05
Posts: 1239
United States
Message 22627 - Posted: 23 Jan 2009, 21:10:58 UTC
Last modified: 23 Jan 2009, 21:11:33 UTC

QMC@Home Update

Martin wrote:

Unfortunately two disks in our RAID-system
failed at the same time so that we cannot simply switch to a spare disk
and had to put the server offline.

Fortunately one disk seems to partly work so that we can carefully rebuild the
RAID from two working, a half-working and a new disk to afterwards change the
half-working disk with a new one (which seems to work but takes hours and
hours of moving data around).

The rebuild process will take some time so that I don't expect to get the
server running again before tomorrow or even Sunday. We don't want to get
online with the half-working disk and in any case files may be corrupted,
which will require some work.

If all goes wrong we do have a 1-day old backup of the whole database and
backups of almost all project files, but a lot of workunit input and output
would be lost.
ID: 22627 · Report as offensive
ProfileKSMarksPsych
Avatar

Send message
Joined: 30 Oct 05
Posts: 1239
United States
Message 22633 - Posted: 24 Jan 2009, 8:24:17 UTC

QMC@Home update

Martin wrote:


The first rebuild (with the half-broken disk) was successfull!!! The other
rebuild (with the working disks) is a trivial task. I think that the server
will be fully working again this evening.

In principle we could go online while the second rebuilding is working, but it
would slow the server down and I think it would be more save to first check
the file system after the second rebuild in our two-disk-disaster case.
ID: 22633 · Report as offensive
ProfileKSMarksPsych
Avatar

Send message
Joined: 30 Oct 05
Posts: 1239
United States
Message 22645 - Posted: 24 Jan 2009, 12:59:32 UTC

QMC@Home Update

QMC@Home is now back up.

Details can be found here.

ID: 22645 · Report as offensive
mo.v
Avatar

Send message
Joined: 13 Aug 06
Posts: 778
United Kingdom
Message 22816 - Posted: 1 Feb 2009, 13:43:12 UTC

CPDN main project

Upload server uploader.oerc is down. This will affect uploads from some, but not all, CPDN models. If your CPDN uploads are unsuccessful please suspend BOINC network activity if you can.

Milo knows about the server problem and will be dealing with it tomorrow.
ID: 22816 · Report as offensive
mo.v
Avatar

Send message
Joined: 13 Aug 06
Posts: 778
United Kingdom
Message 22822 - Posted: 1 Feb 2009, 16:32:50 UTC

When I looked at this forum section it said the last post was made 8 days ago. But I posted the above message just a couple of hours ago.

When one of the forum admins has noticed this please just delete this post.
ID: 22822 · Report as offensive
mo.v
Avatar

Send message
Joined: 13 Aug 06
Posts: 778
United Kingdom
Message 22825 - Posted: 1 Feb 2009, 17:59:19 UTC

The CPDN servers are now all up and running. Thanks, Milo.
ID: 22825 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15549
Netherlands
Message 22920 - Posted: 6 Feb 2009, 12:06:08 UTC

It appears that Milkyway went down. I'll ask what happened to them and when they expect to be back.
ID: 22920 · Report as offensive
Alinator

Send message
Joined: 8 Jan 06
Posts: 36
United States
Message 22923 - Posted: 6 Feb 2009, 17:34:37 UTC - in response to Message 22920.  

Jord,

Did you hear anything back from Dave or Travis yet. We can only assume something really bad happened to the project backend.

They've been down long enough now that I have completed work waiting to go back which is over the deadline. So I am really hoping they don't just throw the switch wide open when they get it fixed, and use a staggered startup instead. ;-)

Alinator
ID: 22923 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15549
Netherlands
Message 22925 - Posted: 6 Feb 2009, 18:10:34 UTC - in response to Message 22923.  

Travis Desell, Milkyway Admin wrote:
Hey,

Yeah the mysql database got corrupted yesterday. We've been working on getting it fixed and the server up and running right. I hope it should be back today.
ID: 22925 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15549
Netherlands
Message 22926 - Posted: 6 Feb 2009, 18:45:49 UTC - in response to Message 22925.  

Travis Desell, Milkyway Admin wrote:
We're just waiting on the database to finish rebuilding itself and for the data to be verified. Our labstaff is saying it should be ok by the end of the day :)
ID: 22926 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15549
Netherlands
Message 22928 - Posted: 6 Feb 2009, 19:10:08 UTC - in response to Message 22926.  

Travis wrote:
Ageless wrote:
Is there any trouble to be expected with (and for) the work that people still have and are trying to upload and report? Or do you think this is all lost (and could we just as well reset anyway?)

I think it should be fine. They should be able to upload when the server comes back.

ID: 22928 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15549
Netherlands
Message 22942 - Posted: 7 Feb 2009, 10:06:45 UTC

Milkyway is back.
ID: 22942 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15549
Netherlands
Message 22948 - Posted: 8 Feb 2009, 0:22:46 UTC
Last modified: 8 Feb 2009, 1:01:07 UTC

Milkyway is still having problems with outages, project pages and forums not loading, intermittent database trouble and such fun things. They are not releasing work at the moment, trying to figure out what is causing their troubles.
ID: 22948 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15549
Netherlands
Message 22954 - Posted: 8 Feb 2009, 19:06:38 UTC

Milkyway has work available again.
ID: 22954 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 15 · Next

Message boards : Projects : News on project outages.

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.