Posts by Ty

InfoMessage
1) Message boards : BOINC client : Folks who disappear after downloading only one WU.
Message 12588
Posted 19 Sep 2007 by ProfileTy
[quote]In perusing WUs, I’m surprised how many instances there are where a person has downloaded ONE (1) WU, and then is never heard from again. I know this doesn’t stop, but only delays, WU completion due to WU being reissued.
[\\quote]

All I can give you is my experiences.

I first connected to SETI because it gets a lot of publicity. When I connected up however, it was down after crunching just 1 or 2 WU's because of a server outage. Then when it was finally restored (weeks later) the work units kept failing to download successfully because the checksum failed. I finally tracked this down to my firewall settings. Then Seti work units kept bombing. Apparently they aren't set up for quad processors or something. There was a lot of cycle waste. I felt like my contribution was taken for granted too so I moved on to some other projects.

One of these was CPDN. Every time I connect to a new project I get flooded with work units so I learned how to control work manually and tune the parameters to stop the bad behavior. Imagine bening new to BOINC getting flooded with CPDN wu's. More than 1 is too many of those monsters. I've crunched for grid.org since 2000 but this was a trip.

CPDN was the second project I connected to. I about fell out of my chair when I saw the hours. Thought it was a mistake! No its for real. So the machine I'm doing crunching on is a dual boot machine. I can't run a WU on both OS's because of the way BOINC identifies a machine. If I stay on one of the OS's for too long I'll miss the deadline. Now I run a special resident program as a service along with BOINC to tightly control how much work is downloaded for any particular project. Trying to get BOINC modified for decent task loading behavior is an effort in futility I think. I moved CPDN to another single cpu machine machine I have that's up 24/7. I experienced several wu bombs at different percentages. I have yet to finish one CPDN wu successfully but there is one wu cranking now over half done. No I'm not going to do special backups to restart a CPDN that crashes. If that happens because I took a stop or something they need to look at the dump.

Finally I found a few projects (QMC and Einstein) that run a decent length work unit and are stable. uFluid is cool because its wu's are very short but they don't feed work all the time. That's OK.

I'll run Superlink when it gets back on line and that's enough tasks for my quad. I try hard to return back every wu I pull but because of the uneven behavior of BOINC I've had to scrap a few. My apologies to those projects that I wasted a little time on because I had to kill a wu.

Some folks won't put up with all this.



2) Message boards : The Lounge : Make a new word with...
Message 11721
Posted 19 Jul 2007 by ProfileTy
Astronomical
3) Message boards : BOINC Manager : My wish list
Message 11433
Posted 1 Jul 2007 by ProfileTy
On the subject of "Force Task", could it be implemented to operate on only one task. So that once that chosen task has completed everything returns to normal.

I see it as;
select task.
click Force button,
Force button is now greyed out for other tasks, but can be used to un-force the selected task.
task finishes,
BOINC returns to normal operation and Force button is free to be used for another task.

Of course if you really wanted to get complicated then it could be expanded to one "Force"/cpu.

Andy

edit] I would probably want to see the "Force" button greyed out if BOINC was in EDF. [/edit


I think that feature could be very useful for a box that's over committed with lots of projects. Consider the case of a small mix of projects though (my case)(i.e. a few more than the number of cpu's say). Then, IF we have a "ceiling on the number of tasks any one project could have open" feature I think a BOINC would simply meet its targets without any need for further human intervention once the pool is initially set up.

For the case there are lots of work units pulled down I've seen a few go to sleep for a little while even in running state. They are all low priority in XP. I get the impression XP may actually be what's responsible for putting some of them to sleep instead of BOINC. They run as separate tasks in XP after all.

If you have a whole lot of projects in the execution pool the feature to put a ceiling on the number of wu's open per project like I have proposed isn't going to help much. For that case the box is already over committed with projects. The best a ceiling feature might do for the "tons-of-projects" case would be to help keep the work pool balanced when some projects are manually suspended or perhaps when a bunch of them run out of out of work at the same time.

4) Message boards : BOINC Manager : My wish list
Message 11432
Posted 1 Jul 2007 by ProfileTy
During the day when I need part or all of my system back if I don't very carefully turn off new work requests AND THEN suspend the projects it causes more work to come down and the over commit happens etc..

As there seems not to be a lot of interest for the feature so far and iot doesn't look like its going to happen I'm trying to figure it out.


If you crunch a lot of projects it can be confusing and a nuisance. One very simple yet very effective solution... write scripts that automate turning new work requests on/off. They would call boinccmd.exe with the --project url op args. Suppose you crunch LHC and ABC. The script to turn off new work would be like:

boinccmd --host localhost --passwd <password> --project http://abcathome.com/ nomorework
boinccmd --host localhost --passwd <password> --project http://lhcathome.cern.ch/lhcathome nomorework

The turn work on script would be like:

boinccmd --host localhost --passwd <password> --project http://abcathome.com/ allowmorework
boinccmd --host localhost --passwd <password> --project http://lhcathome.cern.ch/lhcathome allowmorework

If you need more details on making the scripts work then may I suggest starting a new thread on that matter rather than cluttering this thread.



Well, to automate it I'd have to set up a daemon that would look about twice a second at the work pool to determine which commands to issue. Thats an idea. I'll ponder it for awhile. Thanks.
5) Message boards : The Lounge : Make a new word with...
Message 11425
Posted 1 Jul 2007 by ProfileTy
Latent
6) Message boards : BOINC Manager : My wish list
Message 11412
Posted 29 Jun 2007 by ProfileTy
"Force" Task.

Equivalent to "Resume" suspended tasks, tasks in state "Waiting to run" should be able to be "forced" to continue. Reason: almost finished work units can be finished faster when the user tells. My workaround so far: suspending all other running tasks until the specific task continues - and when it's finished resuming the suspended tasks. But this requires the user to resume the other tasks. A single function "Force" would do this without any further intervention.

I would like to see this too. However I am hesitant to admit it since it would likely take the title for most abused test option. It would be useful to force a specific project or task to run to verify that some new feature is working or a bug has been squished. Suspending projects is more trouble than it is worth most of the time since it usually results in excess work from a project that you were not expecting.

The way I interpreted the rules in 5.8 and up was that even suspended work was counted towards the buffer to stop over committing the overall client. Tested this several times and absolute no additional work was being pulled from any active project.



Your request is a little bit like mine. My BOINC client gets over committed because it tries to pull down enough work to keep all CPU's busy even with the backlog switches set to zero. If several projects are suspended, those that aren't will keep pull down wu's until all the other parameters are satisfied unless I also shut off work requests. Its way complicated. All I want is to limit (a ceiling) the number of wu's any one project in my pool of projects can have on the client regardless of the state of the wu's on the client. Simple. That would balance everything fine. Like you I'm having to manually shut off work unit requests. During the day when I need part or all of my system back if I don't very carefully turn off new work requests AND THEN suspend the projects it causes more work to come down and the over commit happens etc..

As there seems not to be a lot of interest for the feature so far and iot doesn't look like its going to happen I'm trying to figure it out.
7) Message boards : BOINC Manager : BOINC Q&A
Message 11374
Posted 29 Jun 2007 by ProfileTy
I downloaded and installed Tortoise. "Import" command required a password. Maybe that's the wrong command to use. I started browsing. Can do that! I'll take a hard look at the code and see if I can locate the right place for an "opportunity" in the cracks around my other work. I primarily code in COBOL for a living but I can work in C as well. I'm just not nearly as experienced in it and I'm real busy so it will be slow going. I'll get back to you. Thank you for your responses.

Ty



You'll want to right click on a new directory (I called mine BOINC Source) and choose SVN Update, not import from that popout menu. Then put in the URL.

I just created a clean directory on a different partition and it works fine.

Assuming Windows of course...


Thanks Kathryn
I'll give it a try in a bit. BTW we celebrate Eore's Birthday in here in Austin every year.




Let me know if it doesn't work for you.


I lived in Austin for several years while I was in grad school. I think I went one year while I was there.



I got really hacked at BOINC manager tonight. I went to manually allow some new tasks to download and it freed up the wrong project. Started downloading multiple CPDN tasks and one other. I aborted them immediately. I want that one off this machine. I have server I can run it on. So I tried again to download the source to fix this. There is not a SVN Update on the tortoise version I have but there is an SVN Checkout. Now, I didn't want to checkout any source to change, just wanted to get a copy of it. But there were no other choices to run so I selected checkout. It downloaded but it didn't end right. Errored off. After looking at the code for over an hour I decided I really needed to look at cs_scheduler.C or something close to that and it wasn't there. I give up for tonight. I'll try again tomorrow.

8) Message boards : BOINC Manager : BOINC Q&A
Message 11333
Posted 28 Jun 2007 by ProfileTy


The last parameter in the config file isn't parsing. Don't know how to make it happy. <work_request_factor>1</work_request_factor>
I'm real interested in that one obviously.

Ty



I think that parameter was supplanted by: Maintain enough work for an additional
(Requires 5.10+ client under Network in General Preferences.

It has been working for me since I updated to 5.10.8.


I installed 5.10.7 several days ago. I hope it wasn't supplanted. I have have "maintain" set to zero. I don't want any additional work. Thanks for responding.


But that's exactly what that flag did. It allowed extra caching of work. So I'm a bit confused why you want that rather than the current web/local version.


I don't know what the default is so setting it for minimum takes it out of play.
9) Message boards : BOINC Manager : BOINC Q&A
Message 11332
Posted 27 Jun 2007 by ProfileTy
"Wow!!" I need to watch this thread a little closer. Haven't checked on it in a few hours and look at all the commotion I caused over that flag.

I think is worth revisiting my objective again. Like I said in an earlier posting "My ideal environment would be at most two open tasks per project (hard limit), nearly all in running state and no backlog whatsoever. If a project has no work I don't care."

There is a good reason for this. When I allow my computer to take on work from one of these projects I feel some obligation to the project to do whatever I can to get the results done and back in a timely fashion. Also I use this computer for software development and sometimes I have to take it off line to make changes to hardware or the OS. For these reasons I'd rather have the computer be partly idle than risk accidently trashing a bunch of unfinished work. I can take on about two concurrently running tasks during the day and six or even more over night. They have to be very short or good at recovery. I don't want to have a backlog of tasks waiting to run. I'd rather they be loaded and cranking or not there at all.

Adding more CPU threads gets me part way there. Shutting off the ability of BOINC to take on more work than I can have concurrently loaded and executing gets me further. BOINC can still run unbalanced though in this scenario. One project can download as many tasks as I have CPU's and shut the others out for days. I've been using the "no new tasks" button to keep the mix balanced but if there is a flag anywhere that will let me say "only 1 or only 2 tasks per project then I want to set that flag. I think its trying to balance the hours contributed or something. An algorithm like that will favor a newly added project over the others and it could take quite a while for everything to balance.

I know this is volunteer oriented here so eventually I may get around to making the changes myself but my personal work queue is very high too. So for now I'll just go with what's available and manually tweek it now and then.

I really appreciate everyone's interest and attention this. It's way more than I expected. Really!

You're all very kind.

10) Message boards : BOINC Manager : BOINC Q&A
Message 11278
Posted 26 Jun 2007 by ProfileTy


The last parameter in the config file isn't parsing. Don't know how to make it happy. <work_request_factor>1</work_request_factor>
I'm real interested in that one obviously.

Ty

[/quote]

I think that parameter was supplanted by: Maintain enough work for an additional
(Requires 5.10+ client under Network in General Preferences.

It has been working for me since I updated to 5.10.8.
[/quote]

I installed 5.10.7 several days ago. I hope it wasn't supplanted. I have have "maintain" set to zero. I don't want any additional work. Thanks for responding.
11) Message boards : BOINC Manager : BOINC Q&A
Message 11276
Posted 26 Jun 2007 by ProfileTy
I downloaded and installed Tortoise. "Import" command required a password. Maybe that's the wrong command to use. I started browsing. Can do that! I'll take a hard look at the code and see if I can locate the right place for an "opportunity" in the cracks around my other work. I primarily code in COBOL for a living but I can work in C as well. I'm just not nearly as experienced in it and I'm real busy so it will be slow going. I'll get back to you. Thank you for your responses.

Ty



You'll want to right click on a new directory (I called mine BOINC Source) and choose SVN Update, not import from that popout menu. Then put in the URL.

I just created a clean directory on a different partition and it works fine.

Assuming Windows of course...


Thanks Kathryn
I'll give it a try in a bit. BTW we celebrate Eore's Birthday in here in Austin every year.

12) Message boards : BOINC Manager : BOINC Q&A
Message 11267
Posted 26 Jun 2007 by ProfileTy
You can download the source code with Tortoise SVN. The link to use in there is http://boinc.berkeley.edu/svn/trunk/boinc

Compiling it under Windows will need a (usually registered) compiler though. Look at Intel compilers.



Feedback

So far I've had the opportunity to build a cc_config.xml and turn on a few things. Right off I found out that Einstein checkpoints every couple of seconds and ignores the disk write settings. Wow! I also opened my processor up to six cpu's (lied). Actually works quite well most likely because of the capacity in this box. I believe everything has room to just sit in core. No significant thrashing to page file or disk observed. I also notice that no single project can use more than 1 cpu on my box no matter how many open tasks it has. That's a good behavior from my perspective anyway. BOINC still has no issues with downloading as many tasks as I have declared CPUs. Don't like that part at all but at least the # of tasks downloaded is no longer exceeding the CPU count.

The last parameter in the config file isn't parsing. Don't know how to make it happy. <work_request_factor>1</work_request_factor>
I'm real interested in that one obviously.

My ideal environment would be at most two open tasks per project (hard limit), nearly all in running state and no backlog whatsoever. If a project has no work I don't care. BOINC scheduling appears to be deadline oriented. I don't really care about that either. Maybe someday after I've been using BOINC for awhile I'll learn to appreciate the feature. :)

I downloaded and installed Tortoise. "Import" command required a password. Maybe that's the wrong command to use. I started browsing. Can do that! I'll take a hard look at the code and see if I can locate the right place for an "opportunity" in the cracks around my other work. I primarily code in COBOL for a living but I can work in C as well. I'm just not nearly as experienced in it and I'm real busy so it will be slow going. I'll get back to you. Thank you for your responses.

Ty




13) Message boards : BOINC Manager : BOINC Q&A
Message 11107
Posted 21 Jun 2007 by ProfileTy
I decided to take a look at this config file. Search the entire C: drive. Can't find one. Is this part of a source release or something only available in a Linux environment, or is it an optional override file I don't have?

The core client configuration file is something you have to make your self.
See How do I configure my client using the cc_config.xml file? for more information.

What sort of development environment do I need to change the BOINC source to do what I want myself? I hate brick walls.

Software prerequisites (Unix/Linux) and the source code.


Reply:

I'm in a catch 22 on putting up a Unix/Linux environment because I have to transition from XP to Win Server 2003 X64 in order to host Unix as a guest OP sys on the server. MS does not recommend trying to do guesting on XP. I could set up to boot it (did that once) but that's another can of worms so I guess I won't be developing on BOINC in the near term. I can take a look at the source code and may do that a little bit. The htm I can build right away.

BTW in the last day of running on this new release I picked up 1 teeny bug. The HELP/BOINC website pull down opens the BOINC manager help instead of the main BOINC page. Used to work right. Small nit.

Thanks again.

14) Message boards : BOINC Manager : BOINC Q&A
Message 11104
Posted 21 Jun 2007 by ProfileTy
2. For this question, what I'm asking is, if I have 4 cores (which I do) and I lie and say I have 6 will it open and run 6 tasks? What are the ramifications?

You can lie and tell Boinc you have any arbitrary number of CPUs using the <ncpus> tag in the cc_config.xml ovverride file. It has sense for testing purposes, but will cause unnecessary context switches and thrashing the CPU cache (because more applications will share less cores).

I was personally doing this while crunching Malaria WUs - they were (or still are?) prone to stop crunching (or not being preempted, or not starting to consume CPU time after being selected) and effectively causing the CPU to sit idle until someone (me) will notice it. Forcing Boinc scheduler to behave as with 2 CPUs caused to run apps much less effectively, but in case of such acident the other app could run using he whole CPU.

Peter


I appreciate your perspective on this Peter. Thanks for responding.



I decided to take a look at this config file. Search the entire C: drive. Can't find one. Is this part of a source release or something only available in a Linux environment, or is it an optional override file I don't have?

On my question number 3 regarding limiting active tasks per project. I discovered I can sort of get the behavior I want by setting the parameter that controls days of work in advance to zero. What sort of development environment do I need to change the BOINC source to do what I want myself? I hate brick walls.

15) Message boards : BOINC Manager : BOINC Q&A
Message 11095
Posted 21 Jun 2007 by ProfileTy
2. For this question, what I'm asking is, if I have 4 cores (which I do) and I lie and say I have 6 will it open and run 6 tasks? What are the ramifications?

You can lie and tell Boinc you have any arbitrary number of CPUs using the <ncpus> tag in the cc_config.xml ovverride file. It has sense for testing purposes, but will cause unnecessary context switches and thrashing the CPU cache (because more applications will share less cores).

I was personally doing this while crunching Malaria WUs - they were (or still are?) prone to stop crunching (or not being preempted, or not starting to consume CPU time after being selected) and effectively causing the CPU to sit idle until someone (me) will notice it. Forcing Boinc scheduler to behave as with 2 CPUs caused to run apps much less effectively, but in case of such acident the other app could run using he whole CPU.

Peter


I appreciate your perspective on this Peter. Thanks for responding.

16) Message boards : BOINC Manager : BOINC Q&A
Message 11092
Posted 20 Jun 2007 by ProfileTy
1. No, that isn't possible.
BOINC will detect what operating system you are using and make a hostID on the project with the CPU, amount of RAM and that OS.
Signing up with the same computer but a different OS, will make a new hostID.

So you can't run results from the other hostID. Sorry.

2. No.

BOINC will ask the OS how many CPUs there are. Real or virtual ones (think hyperthreading CPUs). And then, even if you fill in 14, but only have 4 CPUs, BOINC will use the maximum amount of CPUs that you truly have: 4.

3. There isn't a way for you to set it. The maximum amount of results that you can download per CPU, per 24 hours, is set by the project. You can check up on that in your preferences, under the list of your computers, click on the hostID number and you'll see a mention of "Maximum daily WU quota per CPU".

If that isn't enough for your computer to keep busy with, you can ask in the project's forums if the daily quota can go up.




Reply

1. Most other applications can't work in a dual boot configuration either but for most of them it doesn't matter. Mozilla and Thunderbird are two very popular exceptions that work in a dual boot config where it does matter. They have an environment pointer in a file that can be altered to point to a different disk. This is just one of many problems I'm dealing with as part of a migration to 64 bit computing. I'll work around it but I guess this question just became my first BOINC feature request.

2. Ok mostly just curious. I could probably get a few more flops out of it with an extra task to two but maybe not.

3. I'm interested in limiting the amount of work I'm getting instead of getting more. I've been using the no new task button to keep any one project from dominating the mix. I don't want a lot of suspended work out there. That's manual intervention. I guess this is feature request number 2 for what its worth.

I've been crunching on grid.org for years until they closed down May 1. That was a very crude engine compared with this one. I'll get used to this one eventually.

Thanks again for your fast response.

17) Message boards : BOINC Manager : BOINC Q&A
Message 11088
Posted 20 Jun 2007 by ProfileTy
I have some questions back and some answers.

1. Are you using the 64bit BOINC client, or the 32bit BOINC client?
If the 64bit BOINC client, I think you can point to the same BOINC directory without much of a problem.

If one is a 32bit client and the other a 64bit client, I would install the 64bit client to its own directory and just attach it to your projects separately (using the same login and password).

And if you don't trust it anyway, or think you'll muck up, always install to its own BOINC directory.

2. It's 8 CPUs which can get work. You can easily have more CPUs in the computer, but they won't get work from the same project. I am not too sure I understand the latter part of your question, could you rewrite it?

3. Like in Project A gets 1 task and project B gets 3 tasks?
You could work around with setting the Project Resource share, that way you can tell which project has priority. But it's quite difficult to say that one project can download 1 task and the other 3, as not all work runs the same amount of time. So for instance, a CPDN model takes over 3 months to run, while a Primegrid task takes mere minutes.


Reply
1. I just today upgraded to 5.10.7 installed over the last release. No problem on XP. I haven't tried it on the 03x64 OS yet. What I want to avoid is having BOINC setting the Win Server 03 X64 as a completely different client with a new set of Wu's. Reason is I only run 03 X64 on weekends and while I'm on it the XP Wu's won't progress if its set up like two different computers. Right now XP OS is on C: drive with BOINC installed in "program files". Win Server 03 x64 boots on H: drive. If I boot 03x64 (H:) and point the 03x64 launcher at the exe on C: will it come up and then be lost or corrupt something or will it work? There are no BOINC entries in the Win Server 2003 X64 registry at this time. If approach will likely fail then if I install BOINC again (same release) over the existing one by executing the installer from the 03x64 platform with the -x64 installer- pointed to the C: drive\program files\BOINC instead of the H:drive will that work? It will cause registry to get populated but I don't know if the environment context will be right and depending on the coding could damage the XP install.

2. For this question, what I'm asking is, if I have 4 cores (which I do) and I lie and say I have 6 will it open and run 6 tasks? What are the ramifications?

3. I was wondering if there is a way to set an upper limit on the number of tasks the scheduler can be allowed to open on a per project basis. (e.g. CPDN max task count is 1 because they are so long, ufluids max task count is 2 because they are so short, etc.) Reason I ask is that would prevent one project from unbalancing a mix with a flood of tasks. This has happened.

Thanks in advance for your time.

18) Message boards : BOINC Manager : BOINC Q&A
Message 11084
Posted 20 Jun 2007 by ProfileTy
I have a few questions for someone in the know on the cutting edge of BOINC development listed in order of importance to me.

1. I have a 64 bit dual AMD processor machine with 2 cores each plus 4 GB ram. Also 1.6 TB disk. OS wise I'm running a dual boot configuration with Windows XP as the first Op sys and Win Server 2003 X64 as the second. I want to get off of XP one of these months (not years) as soon as another major application I run for work gets converted to X64. I was running Win Server 2003 X64 on weekends. Now with BOINC on the XP side I'm reluctant to shut down and boot up in 03 X64. Question is, if I boot X64 is there any way to install or run BOINC in the Server 2003 X64 OS such that it will work on the existing projects? Does it require registry info in order to execute? If not perhaps I could launch it in place. ?? If it requires a complete dual installation and I point the 03 X6 installer to the XP BOINC program files will it execute then with the active projects or am I likely to create a mess. Thought I might ask this first before creating the mess. ::)

2. Does the "max CPU" parameter have a top limit equal to number of hardware CPU's or is it really an OS task maximum? Can safely BOINC run more tasks at once than there are hardware cells?

3. Is there a way to limit the number of tasks any one project can open independently of the others?

19) Message boards : BOINC client : Client not observing the idle and max CPU requests
Message 11043
Posted 19 Jun 2007 by ProfileTy
Hi. Just in the last 48 hours BOINC appears to be giving control to the threads for 1 second in 5. My 4 cores are idle for the other 4. I tried opening up my general parameters several times in several different ways but its not paying attention.

The only thing I have done in this period is add Einstein project to the other three I have running, climate, QMC, and uFluids. Its wasting a lot of time. Suspending these projects in various combinations is not helping.



It sounds like CPU throttling got turned on in your preferences somehow.

Check them on the project website and make sure "use at most of CPU" is set to 100%. Make sure you don't have a global_prefs_override.xml file in the BOINC directory.



Yes I did have some throttling turned on intentionally but when this problem cropped up I set the global preferences on all projects to 100%. No effect. YOU PUT YOUR FINGER RIGHT ON IT though with that suggestion of yours to check for a global_prefs_override.xml. Somehow I must have created one of those by accident yesterday in the process of adding the Einstein project. It was set to 10%. No wonder it was so poky! How did I do that. You fixed it. Cranking now.

Thanks one more time!!

20) Message boards : BOINC client : Client not observing the idle and max CPU requests
Message 11035
Posted 18 Jun 2007 by ProfileTy
Hi. Just in the last 48 hours BOINC appears to be giving control to the threads for 1 second in 5. My 4 cores are idle for the other 4. I tried opening up my general parameters several times in several different ways but its not paying attention.

The only thing I have done in this period is add Einstein project to the other three I have running, climate, QMC, and uFluids. Its wasting a lot of time. Suspending these projects in various combinations is not helping.


Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.