Remaining estimated (time) doubles during run

Message boards : Questions and problems : Remaining estimated (time) doubles during run
Message board moderation

To post messages, you must log in.

AuthorMessage
Lawrence

Send message
Joined: 28 Jun 16
Posts: 4
United Kingdom
Message 70515 - Posted: 28 Jun 2016, 8:10:09 UTC

v 7.6.22
Win-10
Einstein@home
Firstly, I had to open a new account when BOIC suddenly decided that I didn't exist, even though I have posted here before!
I am puzzled that during the E@h runs, what starts off as 12.5 hours, frequently becomes ~20+ in practice. My other BOINC project displays an accurate estimated run time.
Can anyone advise here?
Lawrence
ID: 70515 · Report as offensive
SekeRob2

Send message
Joined: 6 Jul 10
Posts: 585
Italy
Message 70526 - Posted: 28 Jun 2016, 11:11:28 UTC - in response to Message 70515.  

That's generally a problem at projects that cannot accurately estimate before hand how long a given data set will compute, non-homogeneous, non-deterministic. The only thing you can do to get a quicker adjusting of the remaining time of started tasks is to create an app_config.xml for the project and add the <fraction_done_exact/> tag for the specific application.
Coelum Non Animum Mutant, Qui Trans Mare Currunt
ID: 70526 · Report as offensive
Claggy

Send message
Joined: 23 Apr 07
Posts: 1112
United Kingdom
Message 70527 - Posted: 28 Jun 2016, 11:18:42 UTC - in response to Message 70515.  

Einstein runs old Boinc server software, it still uses 'Task duration correction factor', while other projects use 'Average processing rate',
There is only one DCF per project, so each each different application type from a project bumps the runtime up or down as DCF alters,
it can't be very accurate, not without a lot of project fiddling of the different task type's <rsc_fpops_est> values.

Claggy
ID: 70527 · Report as offensive
SekeRob2

Send message
Joined: 6 Jul 10
Posts: 585
Italy
Message 70528 - Posted: 28 Jun 2016, 11:45:24 UTC - in response to Message 70527.  
Last modified: 28 Jun 2016, 11:48:09 UTC

WCG uses v7 server software on dont_use_dcf to stop clients from recomputing the buffer estimates, and its a mess for multiple variable runtime sciences, so they simply pass the returned result fpops averages back into the headers of new work.

We need dcf at app level... something asked for since years, to return the client side buffer estimation functionality.
Coelum Non Animum Mutant, Qui Trans Mare Currunt
ID: 70528 · Report as offensive
Lawrence

Send message
Joined: 28 Jun 16
Posts: 4
United Kingdom
Message 70530 - Posted: 28 Jun 2016, 13:53:23 UTC - in response to Message 70526.  

Thanks everyone for that. I just wanted to know what was going on so I am grateful for the replies :-)

Lawrence
ID: 70530 · Report as offensive
Claggy

Send message
Joined: 23 Apr 07
Posts: 1112
United Kingdom
Message 70544 - Posted: 28 Jun 2016, 20:06:30 UTC - in response to Message 70528.  

We need dcf at app level... something asked for since years, to return the client side buffer estimation functionality.

The Dev's said it couldn't or wouldn't be done, Jason G went and did an experimental Boinc 6.10.58 with it implemented, worked fine, Dev's still weren't interested.

Claggy
ID: 70544 · Report as offensive
SekeRob2

Send message
Joined: 6 Jul 10
Posts: 585
Italy
Message 70555 - Posted: 29 Jun 2016, 7:27:10 UTC - in response to Message 70544.  
Last modified: 29 Jun 2016, 7:35:05 UTC

The development environment has changed with the governance struc. If that code could be revived, checked-in and pulled for a test build, that would be the greatest [and a function to disable the server instruction to <dont_use_dcf/> so members can opt to rely on the client estimator again]. I've always understood that tag as being a stop-gap to issues such as developed e.g. for Muscular Dystrophy where you could have 1 minute and 12 hour jobs coming out for the same app. For the extreme, a server side capping of 'In progress' was introduced, plus AFAIR, DCF up was slow and DCF down was fast. Current cap at WCG is 35 tasks per core, all sub-projects combined, so a client can never totally choke.
Coelum Non Animum Mutant, Qui Trans Mare Currunt
ID: 70555 · Report as offensive

Message boards : Questions and problems : Remaining estimated (time) doubles during run

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.