Thread 'News on Project Outages'

Message boards : Projects : News on Project Outages
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 55 · 56 · 57 · 58 · 59 · 60 · 61 . . . 67 · Next

AuthorMessage
Bernd Machenschalk
Avatar

Send message
Joined: 7 Sep 05
Posts: 15
Message 112519 - Posted: 11 Aug 2023, 9:50:12 UTC
Last modified: 11 Aug 2023, 9:53:07 UTC

Einstein@Home will be shut down on Monday, Aug 14 at about 4 AM UTC due to necessary maintenance work on the power system of the data center. We expect to be back online roughly 36h later on Tuesday, Aug 15, at the end of the working day (2 PM UTC).

We'll post updates here.

BM
ID: 112519 · Report as offensive     Reply Quote
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5128
United Kingdom
Message 112520 - Posted: 11 Aug 2023, 12:01:24 UTC - in response to Message 112519.  

Einstein@Home will be shut down on Monday, Aug 14 at about 4 AM UTC due to necessary maintenance work on the power system of the data center. We expect to be back online roughly 36h later on Tuesday, Aug 15, at the end of the working day (2 PM UTC).
Einstein's own news forum says that the project expects to restart on "Tuesday, around 5 PM UTC." That sounds more sensible for the end of the working day in Europe.
ID: 112520 · Report as offensive     Reply Quote
Bernd Machenschalk
Avatar

Send message
Joined: 7 Sep 05
Posts: 15
Message 112523 - Posted: 14 Aug 2023, 5:09:08 UTC - in response to Message 112519.  

We are shutting down Einstein@Home.
ID: 112523 · Report as offensive     Reply Quote
Bernd Machenschalk
Avatar

Send message
Joined: 7 Sep 05
Posts: 15
Message 112524 - Posted: 14 Aug 2023, 5:17:01 UTC - in response to Message 112520.  

Well, different people work at different times, also in Europe. The technicians usually start early and finish early, we hope to power up E@H at 4 PM CEST.
ID: 112524 · Report as offensive     Reply Quote
Gary Roberts

Send message
Joined: 7 Sep 05
Posts: 130
Australia
Message 112525 - Posted: 14 Aug 2023, 7:02:07 UTC - in response to Message 112523.  

We are shutting down Einstein@Home.
Yes, pretty much right at 5.00am UTC.

I had my hosts store ~3 days of work and now they all have network activity suspended for 2 days until approximately 6.00am UTC on Wednesday. Hopefully the project will be back up by then and at least some of the initial flood of connection attempts will have subsided before any of mine add to the chaos :-). If things go faster than planned, I can easily turn on network activity early and if there are delays I can easily extend the suspension. Hopefully I have enough work on hand to avoid adding to the congestion when service resumes.

I'm sure glad that years ago I developed scripts to give me lots of control over the full fleet of hosts. I'd hate to be doing this on a host by host basis :-).
Cheers,
Gary.
ID: 112525 · Report as offensive     Reply Quote
Bernd Machenschalk
Avatar

Send message
Joined: 7 Sep 05
Posts: 15
Message 112534 - Posted: 15 Aug 2023, 7:48:48 UTC

According to current prediction we should be able to start up Einstein@Home again at roughly 3 PM CEST (1 PM UTC). We'll see.
ID: 112534 · Report as offensive     Reply Quote
Gary Roberts

Send message
Joined: 7 Sep 05
Posts: 130
Australia
Message 112535 - Posted: 15 Aug 2023, 10:57:31 UTC - in response to Message 112534.  

Thanks very much for the update. I'm pleased for you guys that things seem to be going to plan :-).

I'll be in bed by then so hopefully when I next check around 7:30 - 8:00 pm UTC that evening (5:30 - 6:00 am UTC+10 Wednesday my time), I'll be able to set networking back to 'always' and upload all the accumulated results. My script allows me to stagger the uploads (and I have plenty of spare time) so I intend to put a gap of say at least 90 secs between hosts. It will take 3-4 hours (or more) for all the hosts to finish the job. I won't need to download anything until well after the uploads have all finished, so I have no need to push things. After that, I can gradually return to the usual work cache size in small steps over the next couple of days if necessary. The script can do all that for me so it's very easy to get back on track.
Cheers,
Gary.
ID: 112535 · Report as offensive     Reply Quote
Bernd Machenschalk
Avatar

Send message
Joined: 7 Sep 05
Posts: 15
Message 112537 - Posted: 15 Aug 2023, 14:04:28 UTC

Einstein@Home is coming up again. Web server may take a bit, uploads and downloads should work already.
ID: 112537 · Report as offensive     Reply Quote
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5128
United Kingdom
Message 112538 - Posted: 15 Aug 2023, 15:10:16 UTC - in response to Message 112537.  

The few tasks that got caught (11) have all uploaded without interruption, and reported as complete.

I re-enabled work fetch, and immediately got a small allocation, as requested.

So it seems to be going smoothly so far, but I'll keep an eye on it.
ID: 112538 · Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 10 May 07
Posts: 1442
United States
Message 112651 - Posted: 7 Sep 2023, 22:24:34 UTC

Asteroids@home had been unreachable for over at least 8 hours now.
ID: 112651 · Report as offensive     Reply Quote
Steven Gaber

Send message
Joined: 28 Jun 20
Posts: 69
United States
Message 112653 - Posted: 8 Sep 2023, 5:01:42 UTC - in response to Message 112651.  

Asteroids@home had been unreachable for over at least 8 hours now.


YEs, web site, message board inaccessible. I also have a bunch of Asteroids tasks ready to send that are hung up or in transfers.


They are repeating their old tactics. Going incommunicado for days without notice, web site unreachable, no guidance from administrators.

Or maybe they just had a crash? A lightning strike on the university building?

Steven Gaber
Oldsmar, FL
ID: 112653 · Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 10 May 07
Posts: 1442
United States
Message 112657 - Posted: 8 Sep 2023, 14:40:03 UTC

Asteroid@home is back on line. Able to send/receive work.
ID: 112657 · Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 10 May 07
Posts: 1442
United States
Message 112663 - Posted: 10 Sep 2023, 14:39:21 UTC

ODLK1 (aka latinsquares) server is back on line after hardware failure but most everything else is not restarted.

See message https://boinc.multi-pool.info/latinsquares/forum_thread.php?id=190&postid=3692 for more details.
ID: 112663 · Report as offensive     Reply Quote
ProfileCthulhu

Send message
Joined: 18 Nov 20
Posts: 14
Message 112777 - Posted: 29 Sep 2023, 23:18:04 UTC

My thanks to whomever finally removed Cosmology@Home from the project list page!
ID: 112777 · Report as offensive     Reply Quote
Profilemlviper
Avatar

Send message
Joined: 7 Sep 20
Posts: 45
Germany
Message 112854 - Posted: 8 Oct 2023, 17:15:43 UTC

DENIS@home looks like beeing offline. Website is showing "Can't connect to database", no tasks are beeing uploaded or received.
ID: 112854 · Report as offensive     Reply Quote
Stick

Send message
Joined: 10 Oct 09
Posts: 34
United States
Message 113024 - Posted: 1 Nov 2023, 21:45:35 UTC

Apparently, Milkyway@Home has been offline for a few hours now. Getting messages like 11/1/2023 5:04:08 PM | | Project communication failed: attempting access to reference site.
ID: 113024 · Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 10 May 07
Posts: 1442
United States
Message 113026 - Posted: 2 Nov 2023, 0:20:05 UTC - in response to Message 113024.  
Last modified: 2 Nov 2023, 1:15:39 UTC

Received a BOINC notification late yesterday that the system will be offline for approximately 24 hours to perform server upgrade and security updates.

I'm not a a desktop right now to copy/paste the detailed message here.

EDIT... to post the message from MilkyWay
Milkyway@Home: Migrating MilkyWay@home to a New Server
Hello everyone,

We are preparing to migrate MilkyWay@home to a new server on 1 November 2023 at 2 pm UTC. This new server has better hardware (specifically more memory), which we expect will improve the performance of the website and the rate at which you can get new workunits. We are forced to perform this migration at a fast pace due to RPI requiring that we update the server OS to ensure proper security.

We expect that this migration will take one day to complete. If it looks like the downtime will be longer than that, we will update you on our Facebook page. It is possible that the server might experience some unexpected behavior after this migration, but I will be closely monitoring the situation to resolve any issues as they may come up. In particular, I will be watching the message boards closely, and I will make a thread for people to report issues with the new server.

That being said, there were some issues with getting BOINC to recognize the binary up on the new server, so we had to increment the binary version from 1.82 to 1.83. I am not sure what this means for workunits that are awaiting validation after the switch, but I will do what I can to make sure everyone gets as much credit as possible for their work. Unfortunately, it is plausible that you may lose some credit due to the migration, which we apologize for.

I apologize for the short notice and thank you in advance for your patience as I try and make this switch as smooth as possible.

Thank you,
Kevin
10/31/2023 02:25:46 ยท more...
ID: 113026 · Report as offensive     Reply Quote
bramweiser

Send message
Joined: 22 Jan 13
Posts: 13
United States
Message 113044 - Posted: 6 Nov 2023, 0:36:10 UTC - in response to Message 113026.  

Hello,

I just saw a notice in my BOINC application about this, so I tried to follow its instructions, removing the Milky Way project and then adding it back again.

However, while trying to add it back, the application showed the "old" URL and, when I pasted the new URL over it, the attempt to add it failed, so I don't know what's happening, why the application still showed the previous URL instead of the new one, and why I can't follow BOINC's specific instructions.

Can someone please advise me/us about this?

Thanks,
Bram Weiser
ID: 113044 · Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 10 May 07
Posts: 1442
United States
Message 113045 - Posted: 6 Nov 2023, 1:20:26 UTC - in response to Message 113044.  
Last modified: 6 Nov 2023, 1:27:32 UTC

... Can someone please advise me/us about this?

At this time and date there is not much us users can do except WAIT UNTIL TOMORROW (MON 2023-11-06) for the project/university IT managers to FIX ON THEIR END and follow up on the projects message board for further guidance.

Look in the News or Number Crunching forums.
ID: 113045 · Report as offensive     Reply Quote
bramweiser

Send message
Joined: 22 Jan 13
Posts: 13
United States
Message 113046 - Posted: 6 Nov 2023, 1:24:53 UTC - in response to Message 113045.  

Thanks for responding, Dr Who Fan, but I think your post got cut off --> "...follow up on the projects message board for"

I'd still be curious to know why they pushed out this notification without making sure that the system would indeed let us use the new URL that they provided.
ID: 113046 · Report as offensive     Reply Quote
Previous · 1 . . . 55 · 56 · 57 · 58 · 59 · 60 · 61 . . . 67 · Next

Message boards : Projects : News on Project Outages

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.