Thread 'WCG OPNG sans OPN1'

Message boards : Projects : WCG OPNG sans OPN1
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3

AuthorMessage
Aurum
Avatar

Send message
Joined: 13 Sep 17
Posts: 26
United States
Message 106000 - Posted: 6 Nov 2021, 18:24:42 UTC

See: Uploads Stopping for Projects with Large Files #4572
https://github.com/BOINC/boinc/issues/4572
ID: 106000 · Report as offensive
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5129
United Kingdom
Message 106001 - Posted: 6 Nov 2021, 20:43:43 UTC - in response to Message 106000.  

I still think it would be helpful to identify exactly which of the many possible 'transient upload errors' is being encountered in your use case. You referred to my #3778, but that was concerned with the problems which occur with the boinc backoffs when files fail to upload: The cause of that at GPUGrid is well known - a DDoS block on the connection when multiple computers try to connect to the server from the same IP address, in too short a time interval.

Your issue #4572 gives an example of a simple 'transient HTTP error', but the extended http_debug log shows an error-free 'Finished upload of ...' log, which takes us no further forward.

I also run WCG, and I've seen examples of an error "no server is available to handle your request" - which I don't think I've seen at any other BOINC project.

You also mention that you think that the errors are connected with the uploading of 'large' files - can you quantify that? I've recently handled problems caused by attempting to upload files larger than 150 megabytes at CPDN, and 500 megabytes at GPUGrid. Are your files in that sort of size range? Also, in my experience, once a connection has been established and data has started to flow, in general uploads complete: the exception being projects which transfer uploaded files to backing storage, which sometimes accept the whole file and then generate an http gateway error because the backing store is full or offline. Does your error occur at the start of the transfer (in which case the size probably isn't implicated), or does it occur part-way through, or at the end?
ID: 106001 · Report as offensive
Previous · 1 · 2 · 3

Message boards : Projects : WCG OPNG sans OPN1

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.