Posts by cw64

1) Message boards : Questions and problems : High Priority = Wrong Priority (Message 37237)
Posted 20 Mar 2011 by cw64
Post:
Don't know what the best strategy is to avoid any HP, but it's hard to see how many could build up if the cache is very short combined with a long switch time so tasks complete in 1 run, most of the time which would then work kind of very close to FIFO.

As for running out of memory with LAIM on, I was told, then tested and could confirm that if that happens, BOINC will dump preempted tasks from memory if it starts to run short.

More manual switches which runs contrary to a design goal of "set and forget".
If you are not going to fix this problem please give the option to disable the High priority system so it runs only FIFO.

I'm no 'you' that can fix things. I participate on the alpha mailing list as a volunteer and occasionally insert an interruption of regular service. Some were actually taken on board and led to a fix or implementation to make crunching live better. You could do too.


"You" wasn't aimed at anyone specific.

This is the Questions and problems forum?
This is a good place to get problems resloved?

P.S. Dumping tasks causes them to error, which is the problem.
2) Message boards : Questions and problems : High Priority = Wrong Priority (Message 37218)
Posted 19 Mar 2011 by cw64
Post:
Kind of a moot discussion since 6.12 has many scheduler changes, also to address the inordinate running of HP, and stop work fetch where needed. Maybe give 6.12.18 a trial and enroll in the alpha mail list to follow the discussion, though I feel it wont stand for long and the next alpha version will be compiled.

--//--



Still happening with 6.12.18

A secondary problem is that I have to run without leaving suspended apps in memory. Otherwise the constant task switching will cause me to run out of memory (no virtual mem). If you are not going to fix this problem please give the option to disable the High priority system so it runs only FIFO.
3) Message boards : Questions and problems : High Priority = Wrong Priority (Message 37136)
Posted 10 Mar 2011 by cw64
Post:
bump
4) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36159)
Posted 19 Dec 2010 by cw64
Post:
To sum up

When running at high priority, priority should be given to the unit with the earliest deadline and nothing else (except +/- the estimated runtime). Any other system of selection will only and can only increase the chance of units being returned late.

The HP system should* work as follows

A = Present time
B = Task x's due time
e = Task x's estimated time
t = The difference between A and B
n = t +/- e (doesn't matter if it is added or subtracted so long as the same rule is applied for each task)

When running under "High Priority" the task with the lowest value for n is processed first. Once a task selected by HP is running it will run to completion.
If two or more tasks have the same value for n then priority is given to the one with the most accumulated runtime. If two or more of those have the same accumulated runtime then priority is given to the one with the shortest remaining estimated time. If two or more of those have the same remaining time then the choice is arbitrary. Picking one over the other will not effect the chance of units being returned late. n needs only to be calculated once for each task.

* IMO
5) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36157)
Posted 19 Dec 2010 by cw64
Post:
Have you considered reducing the additional work buffer so the computer isn't faced with digesting quite such big dinners in future?


I usually run with half a day of cache. DDDT tasks come in spurts with long periods of none being available. So when they are available I grab as many as I can.


Here is the log file. For some reason it restarted so it's only 12 hours long. If you need a longer period please say so immediately and I will start logging again.

http://rapidshare.com/files/438185963/stdoutdae__2_.rar
6) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36152)
Posted 19 Dec 2010 by cw64
Post:
Proof

http://img152.imageshack.us/img152/452/bottem.png
http://img683.imageshack.us/img683/3161/bottem2.png

Look at the task near the bottem of the pics for Help Cure Muscular Dystrophy. 67% completed in one and 100% in the other. This task has ~2.5 days more until the deadline than the tasks above it. The HP system by returning to complete this task has increased the chance of the tasks above it being returned late. This should be reflected in the pending log.
7) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36130)
Posted 18 Dec 2010 by cw64
Post:
A PITA or not, it is the only way in which you can prove beyond a reasonable doubt that your BOINC isn't doing things according to how it should be doing it, your opinion and screen shots don't do those. It's not so much for me that the logs are for but for the developers. You want them to change BOINC, to fix possible bugs, right? Then you'll have to come with proof they can read.


It was and still is my point that boinc is running correctly. That the HP system has been over complicated to the point of not working as intended. A developer who knows how HP is coded/implemented would know whether the HP system uses my system or something else. Without several miles of text.

It doesn't look like 80MB is going to be big enough to cover 24 hours
38 minutes - 7.62MB
http://rapidshare.com/files/438000304/stdoutdae.old
8) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36116)
Posted 18 Dec 2010 by cw64
Post:
Yet you refuse to give definite proof, by debug logs.
You won't give any information other than that 'you seen it'.

Or you will, but only after the developers change the program so it does what you want it to do, despite what that does to all the other people out there? Bit of a weird demand.

If you want to change it so it runs as you think it should, get the source code and start hacking at it. It's open source. Should be easy for you to make it do what you want, seeing as how you can tell without a shred of evidence that the system is broken beyond (your) repair. :-)

Have fun. I'll not return here, as you make me laugh too much and that's still too painful. :-(


Really? That's big of you. Excuse me for trying to improve boinc. Enjoy your power trip.
PS I haven't refused to provide anything, I was avoiding it because a) it shouldn't be necessary (also the pic I provided illustrates my point perfectly) and b) it is a PITA. However seeing as you walked out of the thread in a big hissy fit not to return it would be pointless to get any debugging data.
9) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36109)
Posted 17 Dec 2010 by cw64
Post:
So if you care to overfill your cache you can see for yourself how boinc doesn't pick the task with the earliest deadline (+/- estimated runtime) first.

Again, run with debug flags to corroborate this claim. In the least <rr_simulation>


Will this do?
http://img152.imageshack.us/img152/452/bottem.png
(4 cores) You can see units have stopped being worked on by the HP system, and units at most risk of going back late are ignored. Sticking to FIFO would be a better solution (in this case) than the HP system.

Of course, overfilling your cache on purpose... well, what do you expect then?

Be it by design or by accident (BTW my system will send all units back on time), I expect a system which sole function is to ensure that work is done on time (or do damage limitation) to actually work as intended. Rather than effectively making the situation worse.
10) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36107)
Posted 17 Dec 2010 by cw64
Post:
Sorry, but a statement is only an hypotheses requiring a reproducible proof to become a theory which may eventually be considered as fact.


It is a fact, and I defy you to describe a scenario where it holds to not be true.
11) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36103)
Posted 17 Dec 2010 by cw64
Post:
...Without all of that information your post is just text on a monitor. No developer will be able to do anything with it as there's nothing to compare it with, or no way to reproduce it.


Actually it is a statement of fact first and formost (i.e. doesn't require proof. It is logical argument which you can workout for yourself).
I did assume that it was a problem in the core code (i.e. it does not follow the rule I suggest) and did not pertain to any particular version, system, etc. So if you care to overfill your cache you can see for yourself how boinc doesn't pick the task with the earliest deadline (+/- estimated runtime) first.

If boinc already uses the system I suggest then the process of debugging can begin and I will throw as much info as you ask for your way. If it doesn't then it needs to be changed.
12) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36102)
Posted 17 Dec 2010 by cw64
Post:
When running at high priority, priority should be given to the unit with the earliest deadline and nothing else (except possibly +/- the estimated runtime). Any other system of selection will only and can only increase the chance of units being returned late.

Imagine you have two tasks on your single-core machine:

  • task A was already running 16 days, 5 hours to go and its deadline is in 6 hours.
  • task B was not running yet, it has 3 hours to go and its deadline is in 4 hours.


Should the client crunch task B, report it soon enough, then continue with task A, report it 2 hours past deadline and risk more than 16 days of work being discarded?
Or should it crunch task A, report it soon enough, then possibly either abort the unstarted task B (because it is already past deadline) and ask for a replacement (to be crunched in-time), or (if not yet past deadline) crunch the task B, report it and risk 3 hours of work being discarded?

The decision is not always that simple, like your imperative "earliest deadline and nothing else"...

Peter



except possibly +/- the estimated runtime


I was thinking along those lines also.

A = Present time
B = Task x's due time
e = Task x's estimated time
t = The difference between A and B
n = t +/- e (doesn't matter if it is added or subtraced so long as the same rule is applied for each task)

When running under "High Priority" the task with the lowest value for n is processed first.
13) Message boards : Questions and problems : High Priority = Wrong Priority (Message 36092)
Posted 17 Dec 2010 by cw64
Post:
When running at high priority, priority should be given to the unit with the earliest deadline and nothing else (except possibly +/- the estimated runtime). Any other system of selection will only and can only increase the chance of units being returned late.
14) Message boards : BOINC Manager : GPU snooze timer (Message 34860)
Posted 23 Sep 2010 by cw64
Post:
How can I alter the duration of the timer?
15) Message boards : BOINC Manager : Project Specific Work Buffer (Message 34397)
Posted 28 Aug 2010 by cw64
Post:
I just wanted to stop Collatz filling up boinc when Milkyway was out of work units.
16) Message boards : BOINC Manager : Project Specific Work Buffer (Message 34389)
Posted 27 Aug 2010 by cw64
Post:
Is it possible to set a work buffer size for a specific project leaving others at the general setting?




Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.