Task exited with zero status but no 'finished' file... (almost) all of them

Author	Message
Joe Bloggs Send message Joined: 6 Jan 13 Posts: 40	Message 47217 - Posted: 14 Jan 2013, 2:12:54 UTC When I came back to my computer this morning (thus suspending GPU but not CPU tasks by my current set preferences), BOINC hung for about a minute but appeared to continue normally. But these messages appeared: 14/1/2013 9:55:26 \| climateprediction.net \| Task hadcm3n_o2aw_2140_40_008269826_3 exited with zero status but no 'finished' file 14/1/2013 9:55:26 \| climateprediction.net \| If this happens repeatedly you may need to reset the project. 14/1/2013 9:55:26 \| Cosmology@Home \| Task wu_011213_110421_3_0_0 exited with zero status but no 'finished' file 14/1/2013 9:55:26 \| Cosmology@Home \| If this happens repeatedly you may need to reset the project. 14/1/2013 9:55:26 \| Cosmology@Home \| Task wu_011213_110423_0_1_0 exited with zero status but no 'finished' file 14/1/2013 9:55:26 \| Cosmology@Home \| If this happens repeatedly you may need to reset the project. 14/1/2013 9:55:26 \| Cosmology@Home \| Task wu_011213_110423_0_0_0 exited with zero status but no 'finished' file 14/1/2013 9:55:26 \| Cosmology@Home \| If this happens repeatedly you may need to reset the project. 14/1/2013 9:55:26 \| SETI@home \| Task ap_24oc12ab_B5_P0_00050_20130106_25020.wu_0 exited with zero status but no 'finished' file 14/1/2013 9:55:26 \| SETI@home \| If this happens repeatedly you may need to reset the project. This appears to include ALL the running WUs EXCEPT the GPU WU, a WCG help conquer cancer WU. The tasks appeared to continue running normally, picking up where they left off, but it sure sounded scary :S I should note that I had set an ultra-short idle to re-run time of 0.01minute so BOINC may have attempted to restart the GPU task in the short time that it hung. I had wanted to let GPU tasks continue running while the computer is in use but many scary incidents involving near-complete hangups of the computer had dissuaded me. Perhaps a race condition involving the GPU project restarting before it had finished suspending had occurred? I'd set the timer back up to 0.5 minute for now. Other system info: 13/1/2013 12:00:48 \| \| No config file found - using defaults 13/1/2013 12:00:48 \| \| Starting BOINC client version 7.0.28 for windows_x86_64 13/1/2013 12:00:48 \| \| log flags: file_xfer, sched_ops, task 13/1/2013 12:00:48 \| \| Libraries: libcurl/7.25.0 OpenSSL/1.0.1 zlib/1.2.6 13/1/2013 12:00:48 \| \| Data directory: D:\ProgramData\BOINC 13/1/2013 12:00:48 \| \| Running under account User 13/1/2013 12:00:48 \| \| Processor: 6 AuthenticAMD AMD Phenom(tm) II X6 1090T Processor [Family 16 Model 10 Stepping 0] 13/1/2013 12:00:48 \| \| Processor: 512.00 KB cache 13/1/2013 12:00:48 \| \| Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 htt pni cx16 syscall nx lm svm sse4a osvw ibs skinit wdt page1gb rdtscp 3dnowext 3dnow 13/1/2013 12:00:48 \| \| OS: Microsoft Windows 7: Ultimate x64 Edition, Service Pack 1, (06.01.7601.00) 13/1/2013 12:00:48 \| \| Memory: 7.50 GB physical, 14.99 GB virtual 13/1/2013 12:00:48 \| \| Disk: 746.35 GB total, 279.01 GB free 13/1/2013 12:00:48 \| \| Local time is UTC +8 hours 13/1/2013 12:00:48 \| \| ATI GPU 0: Redwood (CAL version 1.4.1734, 512MB, 479MB available, 1120 GFLOPS peak) 13/1/2013 12:00:48 \| \| OpenCL: ATI GPU 0: Redwood (driver version 1016.4 (VM), device version OpenCL 1.2 AMD-APP (1016.4), 512MB, 479MB available) 13/1/2013 12:00:48 \| \| Version change (7.0.42 -> 7.0.28) ID: 47217 ·

kdsjsdj Send message Joined: 5 Jan 13 Posts: 81	Message 47221 - Posted: 14 Jan 2013, 4:48:42 UTC - in response to Message 47217. Last modified: 14 Jan 2013, 4:49:14 UTC When I came back to my computer this morning (thus suspending GPU but not CPU tasks by my current set preferences), BOINC hung for about a minute but appeared to continue normally. But these messages appeared: 14/1/2013 9:55:26 \| climateprediction.net \| Task hadcm3n_o2aw_2140_40_008269826_3 exited with zero status but no 'finished' file 14/1/2013 9:55:26 \| climateprediction.net \| If this happens repeatedly you may need to reset the project. There is a regular communication between BOINC client and the science apps it spawns. If BOINC client becomes too busy with other chores to handle that communication the science apps think the client has shutdown so they shutdown too. Since they haven't finished crunching their tasks they don't create their finished file. When BOINC is finally able to resume normal communications with the apps it soon realizes they have exited so it looks for but does not find the finished files. Then it spits out the type of message you see above, then it restarts the tasks and hopefully things carry on as they should. That seems to be exactly what happened to you. It's not an uncommon thing. Why it happened I do not know. I was thinking that if you use a screensaver then it might be due to a problem with the screensaver shutting alongside the GPU task shutting down down when you start using the computer but that's not as likely an explanation as it would have been a few years ago. These days the screensaver runs under the OS itself rather than BOINC (the way it used to be). Nevertheless, if this continues to happen and you are in fact running the BOINC screensavers then turn them off and see if that fixes it. Screensavers are notorious for causing problems and IIRC the climateprediction screensaver is one of the problem ones. This could be just a very unusual and infrequent alignment of a number of factors which you will never see for another 5 years. Let us know if it becomes a regular thing. If it turns out to be one of the screensavers then you won't get much satisfaction from reporting it here, report it instead to the project that issues it. ID: 47221 ·

Joe Bloggs Send message Joined: 6 Jan 13 Posts: 40	Message 47222 - Posted: 14 Jan 2013, 5:09:54 UTC - in response to Message 47221. Not running any screensaver... thanks anyway ID: 47222 ·

Jord Volunteer tester Help desk expert Send message Joined: 29 Aug 05 Posts: 15480	Message 47229 - Posted: 14 Jan 2013, 11:55:16 UTC - in response to Message 47222. Possible causes of the "Task exited with zero status but no 'finished' file" syndrome: 1. Make sure you exclude the BOINC directory and all subdirectories (or the BOINC Data directory and all subdirectories in BOINC 6 and 7) from being actively scanned by anti-virus and anti-spyware software. Only scan when you have exited BOINC. 2. Don't defrag your disk with BOINC on. 3. Don't run Scandisk with BOINC on. 4. Disable Drive Indexing. 5. Update your motherboard chipset drivers, specifically those for your IDE or SATA controllers. 6. Disable the Time synchronization in Windows XP/Vista. Normally found under the clock (double click it in the system tray), third tab (Internet in English), uncheck the sync option. 7. When you use use BOINC's CPU throttling function, you can run into the too many exit(0)s error. The advice here is to disable the BOINC throttling (set it to 100%) and reduce the amount of CPUs/cores for BOINC to use. ** Use at most 100.0 percent of CPU time. * In BOINC 7.0, this is done through the option On multiprocessors, use at most xxx% of the processors. ID: 47229 ·

SekeRob2 Send message Joined: 6 Jul 10 Posts: 585	Message 47238 - Posted: 14 Jan 2013, 14:35:54 UTC - in response to Message 47229. If "too many exits" is invoked by too short an interval between resuming computing, think I saw someone posting 0.01 value, then typing, reading, typing, mousing etc, will continuously stop / start, unload / reload. IIRC that can be done like 100 times before BOINC gives up on a task. To prevent this unloading, select "Leave application in memory when suspended" (If not already done). On Linux, intermittent WIFI can be a source, even Signal 11. Disable power management for the Wlan by executing sudo iwconfig wlan0 power off. Also, experimenting with pausing BOINC depending on "non-BOINC" processor load is a great help for jobs to not incur the too many exits / zero status restart or the said signal 11 task crashing. I found "while processor usage is less than 35%" to be the max at which neither 2 issues would occur. And, increase the Write to Disk interval. Mine 300 seconds, at most, but with heavy tasks with large checkpoint files you'd like to increase that [if the science app listens to the instruction, which not all do]. Every little bit helps to increase throughput and efficiency. P.S. Famously, some overzealous antivirus/security software could also help to cause these problems. Exclude the BOINC data dir and it's subs from scanning [memory continues to be scanned]. BOINC being sandboxed, checking needed files and their sizes and signatures is helping to remain save with that exclusion. Coelum Non Animum Mutant, Qui Trans Mare Currunt ID: 47238 ·

kdsjsdj Send message Joined: 5 Jan 13 Posts: 81	Message 47250 - Posted: 14 Jan 2013, 19:33:20 UTC There ya go, lots of possible causes :-) If this happens only once or twice a day you can probably safely ignore it because it is not necessarily a prophecy of disaster As Sek says, the client does nothing about this until it sees that a science app has exited 100 times without a finished file. If it sees 100 such exits it will abort the task. But if you're getting only 1 or 2 such exits in a day then take it as proof one of BOINC's sanity controls or self-check mechanisms is working as it should and don't worry about it too much. I have a notebook I use for crunching and I get several such events per day if I'm using it. It does no real harm, IMHO it's more work to hunt down the cause than it's worth, I live with it. YMMV. ID: 47250 ·

Joe Bloggs Send message Joined: 6 Jan 13 Posts: 40	Message 47274 - Posted: 15 Jan 2013, 15:29:47 UTC I think climateprediction fell victim to the "100x Task exited with zero status but no 'finished' file" bug :( I ran through the log (which has the alpha testing debug flags set) and found that I was getting several of these "all tasks exit with zero status but no finished file" bugs today. I think I've found something in common between them. Let me demonstrate--I've captured the events leading up to three instances of all the tasks exiting with zero status but no finished file: I think what's in common between them is that the scheduler starts and rr_sim runs through time estimations for a crapton of candidate WUs for download, then half a minute later all the tasks error out. I suspect what is happening here is that BOINC is too busy with itself running time estimations to notice the WUs prodding it for attention. [---1---] 15/1/2013 8:43:21 \| MindModeling@Beta \| [task] Process for MindModeling-279-50f48229db617_0 exited, exit code 0, task state 1 15/1/2013 8:43:21 \| MindModeling@Beta \| [task] task_state=EXITED for MindModeling-279-50f48229db617_0 from handle_exited_app 15/1/2013 8:43:21 \| \| [cpu_sched_debug] Request CPU reschedule: application exited 15/1/2013 8:43:21 \| \| [work_fetch] Request work fetch: application exited 15/1/2013 8:43:21 \| MindModeling@Beta \| Computation for task MindModeling-279-50f48229db617_0 finished 15/1/2013 8:43:21 \| MindModeling@Beta \| [task] result state=FILES_UPLOADING for MindModeling-279-50f48229db617_0 from CS::app_finished 15/1/2013 8:43:21 \| \| [cpu_sched_debug] Request CPU reschedule: handle_finished_apps 15/1/2013 8:43:21 \| \| [cpu_sched_debug] schedule_cpus(): start 15/1/2013 8:43:21 \| \| [rr_sim] start: work_buf min 86400 additional 3456 total 89856 on_frac 0.987 active_frac 0.999 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 0.00: X0930099511393200806051135_0 finishes (19414.18G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 899.78: X0930099511304200806051137_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 1181.60: X0930099511288200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 2081.38: X0930099511504200806051134_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 2363.21: X0930099511490200806051134_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 3262.98: X0930099511436200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 3544.81: X0930099511429200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 4444.59: X0930099511497200806051134_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 4726.41: X0930099511346200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 5626.19: X0930099511451200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 5908.01: X0930099511411200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 6807.79: X0930099511461200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 7089.62: X0930099511418200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 7989.39: X0930099511377200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 8271.22: X0930099511455200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 9171.00: X0930099511431200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 9452.82: X0930099511470200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| Cosmology@Home \| [rr_sim] 10352.60: wu_011213_110423_0_0_0 finishes (26420.75G/2.51G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 10528.62: X0930099511406200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 10634.42: X0930099511360200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 11534.20: X0930099511410200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 11816.03: X0930099511330200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 12715.80: X0930099511297200806051137_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 12997.63: X0930099511372200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 13897.41: X0930099511476200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 14179.23: X0930099511444200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 15079.01: X0930099511488200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 15360.83: X0930099511427200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 16260.61: X0930099511473200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 16542.44: X0930099511353200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 17442.21: X0930099511420200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 17724.04: X0930099511396200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 18623.82: X0930099511466200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 18905.64: X0930099511446200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 19805.42: X0930099511401200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 20087.24: X0930099511327200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 20987.02: X0930099511303200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 21268.85: X0930099511494200806051134_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 22168.63: X0930099511312200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 22450.45: X0930099511391200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 23350.23: X0930099511389200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 23632.05: X0930099511392200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 24531.83: X0930099511381200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 24813.66: X0930099511464200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 25713.43: X0930099511483200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 25995.26: X0930099511439200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 26895.04: X0930099511487200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 27176.86: X0930099511416200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 28076.64: X0930099511500200806051134_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 28358.46: X0930099511434200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 29258.24: X0930099511328200806051137_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 29540.07: X0930099511452200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 30439.84: X0930099511336200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 30721.67: X0930099511443200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 31621.45: X0930099511457200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 31903.27: X0930099511310200806051137_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 32803.05: X0930099511356200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 33084.87: X0930099511405200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 33984.65: X0930099511342200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 34266.48: X0930099511417200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 35166.25: X0930099511321200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 35448.08: X0930099511373200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 36347.86: X0930099511287200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 36629.68: X0930099511364200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 37529.46: X0930099511485200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 37811.28: X0930099511332200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 38711.06: X0930099511478200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 38992.89: X0930099511424200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 39892.66: X0930099511317200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 40174.49: X0930099511468200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 41074.27: X0930099511433200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 41356.09: X0930099511428200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 42255.87: X0930099511361200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 42537.69: X0930099511430200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 43437.47: X0930099511307200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 43719.30: X0930099511376200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 44619.08: X0930099511370200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 44900.90: X0930099511291200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 45800.68: X0930099511388200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 46082.50: X0930099511462200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 46982.28: X0930099511293200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| SETI@home \| [rr_sim] 47264.11: ap_24oc12ab_B5_P0_00050_20130106_25020.wu_0 finishes (579358.98G/15.66G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 47529.15: MindModeling-279-50f482126ebaf_0 finishes (13659.44G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f482126ebaf_0 misses deadline by 31893.36 15/1/2013 8:43:21 \| World Community Grid \| [rr_sim] 48073.48: X0930099511384200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 48163.88: MindModeling-279-50f4954a49b1a_0 finishes (24344.61G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954a49b1a_0 misses deadline by 27929.49 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 49043.61: collatz_2378086850039686867304_103079215104_0 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 50134.15: MindModeling-279-50f4954a1d813_0 finishes (74935.09G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954a1d813_0 misses deadline by 30915.64 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 52029.76: collatz_2378086837670181054824_103079215104_0 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 53004.20: MindModeling-279-50f4954a723a6_0 finishes (88342.87G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954a723a6_0 misses deadline by 34436.09 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 55550.21: collatz_2378130805490908375400_103079215104_0 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 55874.25: collatz_2378130807655571892584_103079215104_1 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 58744.30: MindModeling-279-50f4954a9f630_0 finishes (94337.10G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954a9f630_0 misses deadline by 38195.41 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 59309.53: collatz_2378130807552492677480_103079215104_0 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 61614.35: MindModeling-279-50f4954ac922a_0 finishes (94337.10G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954ac922a_0 misses deadline by 41954.72 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 63068.84: collatz_2378130805387829160296_103079215104_1 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| Cosmology@Home \| [rr_sim] 64484.40: wu_011313_163116_3_0_0 finishes (163195.72G/2.51G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 65033.21: MindModeling-279-50f49e4188ced_0 finishes (94337.10G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e4188ced_0 misses deadline by 42820.04 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 66828.16: collatz_2378130807758651107688_103079215104_1 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| Cosmology@Home \| [rr_sim] 67354.45: wu_011313_163131_1_1_0 finishes (169229.50G/2.51G) 15/1/2013 8:43:21 \| Cosmology@Home \| [rr_sim] 67437.67: wu_011313_201605_0_0_0 finishes (169258.35G/2.51G) 15/1/2013 8:43:21 \| Cosmology@Home \| [rr_sim] 67449.16: wu_011313_201604_2_0_0 finishes (169258.35G/2.51G) 15/1/2013 8:43:21 \| Cosmology@Home \| [rr_sim] 67449.16: wu_011313_201604_2_1_0 finishes (169258.35G/2.51G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 67449.16: MindModeling-279-50f49e41ad85c_0 finishes (94337.10G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e41ad85c_0 misses deadline by 44784.41 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 68792.53: collatz_2378130805593987590504_103079215104_0 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 70224.50: MindModeling-279-50f49e41d6131_0 finishes (94337.10G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e41d6131_0 misses deadline by 46579.36 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 70587.48: MindModeling-279-50f49e413f32c_0 finishes (94337.10G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e413f32c_0 misses deadline by 47188.86 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 71196.98: MindModeling-279-50f49e4163c94_0 finishes (94337.10G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e4163c94_0 misses deadline by 47200.36 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] 71208.48: MindModeling-279-50f4a0a545897_0 finishes (94337.10G/25.09G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4a0a545897_0 misses deadline by 46953.36 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 71208.48: poempp_anticancer_aurein_1358049165_465841097_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 73608.85: poempp_anticancer_aurein_1358049164_691345986_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 75403.80: poempp_anticancer_aurein_1358049165_1852562564_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 76013.30: poempp_anticancer_aurein_1358049166_1260141213_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 76024.80: poempp_anticancer_aurein_1358049166_163313666_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 76024.80: poempp_anticancer_aurein_1358049159_1305964167_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 78425.17: collatz_2378130787348966517096_824633720832_1 finishes (1589218.21G/86.49G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 79988.40: poempp_anticancer_aurein_1358049157_1658442024_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 80220.12: poempp_anticancer_aurein_1358049159_1468760754_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 80829.62: poempp_anticancer_aurein_1358049161_1524715615_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 80841.12: poempp_anticancer_aurein_1358049163_1768422218_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 80841.12: collatz_2378132473828004833640_103079215104_0 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 82858.45: poempp_anticancer_aurein_1358049157_1202789532_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 83241.49: poempp_anticancer_aurein_1358049161_1268625719_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 85036.43: poempp_anticancer_aurein_1358049163_1503956672_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 85645.94: poempp_anticancer_aurein_1358049157_2021110191_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 85657.44: poempp_anticancer_aurein_1358049159_124314130_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 85657.44: poempp_anticancer_aurein_1358049158_1590278216_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 88057.81: poempp_anticancer_aurein_1358049157_301753657_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 89852.75: collatz_2378130788173600237928_824633720832_0 finishes (1699376.62G/86.49G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 89872.17: collatz_2378130727047625681256_824633720832_0 finishes (1699376.62G/86.49G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 89872.17: collatz_2378130765186935269736_824633720832_0 finishes (1699376.62G/86.49G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 89872.17: collatz_2378132512998106573160_824633720832_0 finishes (1699376.62G/86.49G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 89872.17: poempp_anticancer_aurein_1358049154_29679182_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 90462.26: poempp_anticancer_aurein_1358049165_147056271_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Poem@Home \| [rr_sim] 90473.75: poempp_anticancer_aurein_1358049162_600610906_0 finishes (192000.00G/39.86G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 90473.75: collatz_2378132473724925618536_103079215104_0 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 92742.22: collatz_2378132501040917621096_103079215104_1 finishes (212422.08G/74.01G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 99212.27: collatz_2378132542272603662696_824633720832_1 finishes (1699376.62G/86.49G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 113306.12: collatz_2378132555879060056424_824633720832_1 finishes (1699376.62G/86.49G) 15/1/2013 8:43:21 \| Collatz Conjecture \| [rr_sim] 115259.94: collatz_2378132541447969941864_824633720832_0 finishes (1699376.62G/86.49G) 15/1/2013 8:43:21 \| climateprediction.net \| [rr_sim] 1259150.46: hadcm3n_o2aw_2140_40_008269826_3 finishes (3087600.07G/2.58G) 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f482126ebaf_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f4954a49b1a_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f4954a1d813_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f4954a723a6_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f4954a9f630_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f4954ac922a_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f49e4188ced_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f49e41ad85c_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f49e41d6131_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f49e413f32c_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f49e4163c94_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Result MindModeling-279-50f4a0a545897_0 projected to miss deadline. 15/1/2013 8:43:21 \| MindModeling@Beta \| [rr_sim] Project has 12 projected CPU deadline misses 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] scheduling X0930099511393200806051135_0 (coprocessor job, FIFO) (prio -1.894384) 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] reserving 0.800000 of coproc ATI 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511304200806051137_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511288200806051138_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511504200806051134_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511490200806051134_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511436200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511429200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511497200806051134_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511346200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511451200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511411200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511461200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511418200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511377200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511455200806051135_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511431200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511470200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511406200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511360200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511410200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511330200806051138_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511297200806051137_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511372200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511476200806051135_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511444200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511488200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511427200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511473200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511353200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511420200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511396200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511466200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511446200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511401200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511327200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511303200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511494200806051134_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511312200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511391200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511389200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511392200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511381200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511464200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511483200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511439200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511487200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511416200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511500200806051134_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511434200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511328200806051137_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511452200806051135_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511336200806051138_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511443200806051135_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511457200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511310200806051137_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511356200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511405200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511342200806051138_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511417200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511321200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511373200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511287200806051138_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511364200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511485200806051135_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511332200806051138_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511478200806051135_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511424200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511317200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511468200806051135_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511433200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511428200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511361200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511430200806051136_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511307200806051137_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511376200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511370200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511291200806051138_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511388200806051136_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511462200806051135_1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511293200806051138_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] insufficient ATI for X0930099511384200806051136_1 15/1/2013 8:43:21 \| Collatz Conjecture \| [cpu_sched_debug] scheduling collatz_2378130787348966517096_824633720832_1 (coprocessor job, FIFO) (prio -14.990155) 15/1/2013 8:43:21 \| Collatz Conjecture \| [cpu_sched_debug] reserving 0.200000 of coproc ATI 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] earliest deadline: 1358313182 MindModeling-279-50f482126ebaf_0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f482126ebaf_0 (CPU job, EDF) (prio -0.024774) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] earliest deadline: 1358318116 MindModeling-279-50f4954a49b1a_0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f4954a49b1a_0 (CPU job, EDF) (prio -0.027522) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] earliest deadline: 1358318116 MindModeling-279-50f4954a1d813_0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f4954a1d813_0 (CPU job, EDF) (prio -0.030270) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] earliest deadline: 1358318116 MindModeling-279-50f4954a723a6_0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f4954a723a6_0 (CPU job, EDF) (prio -0.033018) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] earliest deadline: 1358318116 MindModeling-279-50f4954a9f630_0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f4954a9f630_0 (CPU job, EDF) (prio -0.035766) 15/1/2013 8:43:21 \| \| [cpu_sched_debug] enforce_schedule(): start 15/1/2013 8:43:21 \| \| [cpu_sched_debug] preliminary job list: 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] 0: X0930099511393200806051135_0 (MD: no; UTS: yes) 15/1/2013 8:43:21 \| Collatz Conjecture \| [cpu_sched_debug] 1: collatz_2378130787348966517096_824633720832_1 (MD: no; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 2: MindModeling-279-50f482126ebaf_0 (MD: yes; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 3: MindModeling-279-50f4954a49b1a_0 (MD: yes; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 4: MindModeling-279-50f4954a1d813_0 (MD: yes; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 5: MindModeling-279-50f4954a723a6_0 (MD: yes; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 6: MindModeling-279-50f4954a9f630_0 (MD: yes; UTS: no) 15/1/2013 8:43:21 \| \| [cpu_sched_debug] final job list: 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 0: MindModeling-279-50f482126ebaf_0 (MD: yes; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 1: MindModeling-279-50f4954a49b1a_0 (MD: yes; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 2: MindModeling-279-50f4954a1d813_0 (MD: yes; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 3: MindModeling-279-50f4954a723a6_0 (MD: yes; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] 4: MindModeling-279-50f4954a9f630_0 (MD: yes; UTS: no) 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] 5: X0930099511393200806051135_0 (MD: no; UTS: yes) 15/1/2013 8:43:21 \| Collatz Conjecture \| [cpu_sched_debug] 6: collatz_2378130787348966517096_824633720832_1 (MD: no; UTS: yes) 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f482126ebaf_0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f4954a49b1a_0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f4954a1d813_0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f4954a723a6_0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] scheduling MindModeling-279-50f4954a9f630_0 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] scheduling X0930099511393200806051135_0 15/1/2013 8:43:21 \| Collatz Conjecture \| [cpu_sched_debug] scheduling collatz_2378130787348966517096_824633720832_1 15/1/2013 8:43:21 \| climateprediction.net \| [cpu_sched_debug] hadcm3n_o2aw_2140_40_008269826_3 sched state 1 next 1 task state 0 15/1/2013 8:43:21 \| Cosmology@Home \| [cpu_sched_debug] wu_011213_110423_0_0_0 sched state 1 next 1 task state 0 15/1/2013 8:43:21 \| SETI@home \| [cpu_sched_debug] ap_24oc12ab_B5_P0_00050_20130106_25020.wu_0 sched state 1 next 1 task state 0 15/1/2013 8:43:21 \| Cosmology@Home \| [cpu_sched_debug] wu_011313_163116_3_0_0 sched state 1 next 1 task state 0 15/1/2013 8:43:21 \| Cosmology@Home \| [cpu_sched_debug] wu_011313_163131_1_1_0 sched state 1 next 1 task state 0 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] MindModeling-279-50f482126ebaf_0 sched state 2 next 2 task state 1 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] MindModeling-279-50f4954a49b1a_0 sched state 2 next 2 task state 1 15/1/2013 8:43:21 \| Collatz Conjecture \| [cpu_sched_debug] collatz_2378130787348966517096_824633720832_1 sched state 2 next 2 task state 1 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] MindModeling-279-50f4954a1d813_0 sched state 2 next 2 task state 1 15/1/2013 8:43:21 \| World Community Grid \| [cpu_sched_debug] X0930099511393200806051135_0 sched state 2 next 2 task state 1 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] MindModeling-279-50f4954a723a6_0 sched state 2 next 2 task state 1 15/1/2013 8:43:21 \| MindModeling@Beta \| [cpu_sched_debug] MindModeling-279-50f4954a9f630_0 sched state 0 next 2 task state 0 15/1/2013 8:43:21 \| \| [cpu_sched_debug] app startup took 29.496687 secs 15/1/2013 8:43:21 \| \| [cpu_sched_debug] Request CPU reschedule: slow app startup 15/1/2013 8:43:21 \| \| [cpu_sched_debug] enforce_schedule: end 15/1/2013 8:43:55 \| MindModeling@Beta \| [task] Process for MindModeling-279-50f482126ebaf_0 exited, exit code 0, task state 1 15/1/2013 8:43:55 \| MindModeling@Beta \| Task MindModeling-279-50f482126ebaf_0 exited with zero status but no 'finished' file 15/1/2013 8:43:55 \| MindModeling@Beta \| If this happens repeatedly you may need to reset the project. 15/1/2013 8:43:55 \| MindModeling@Beta \| [task] task_state=UNINITIALIZED for MindModeling-279-50f482126ebaf_0 from handle_premature_exit 15/1/2013 8:43:55 \| \| [cpu_sched_debug] Request CPU reschedule: application exited 15/1/2013 8:43:55 \| \| [work_fetch] Request work fetch: application exited 15/1/2013 8:43:55 \| MindModeling@Beta \| [task] Process for MindModeling-279-50f4954a49b1a_0 exited, exit code 0, task state 1 15/1/2013 8:43:55 \| MindModeling@Beta \| Task MindModeling-279-50f4954a49b1a_0 exited with zero status but no 'finished' file 15/1/2013 8:43:55 \| MindModeling@Beta \| If this happens repeatedly you may need to reset the project. 15/1/2013 8:43:55 \| MindModeling@Beta \| [task] task_state=UNINITIALIZED for MindModeling-279-50f4954a49b1a_0 from handle_premature_exit [---2---] 15/1/2013 8:53:04 \| \| [work_fetch] work fetch start 15/1/2013 8:53:04 \| \| [rr_sim] start: work_buf min 86400 additional 3456 total 89856 on_frac 0.987 active_frac 0.999 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 0.00: X0930099511393200806051135_0 finishes (8957.30G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 415.13: X0930099511304200806051137_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 1181.57: X0930099511288200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 1596.69: X0930099511504200806051134_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 2363.14: X0930099511490200806051134_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 2778.26: X0930099511436200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 3544.70: X0930099511429200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 3959.83: X0930099511497200806051134_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 4726.27: X0930099511346200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 5141.40: X0930099511451200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 5907.84: X0930099511411200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 6322.97: X0930099511461200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 7089.41: X0930099511418200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 7504.53: X0930099511377200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 8270.97: X0930099511455200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 8686.10: X0930099511431200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 9452.54: X0930099511470200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| Cosmology@Home \| [rr_sim] 9867.67: wu_011213_110423_0_0_0 finishes (26420.75G/2.51G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 10528.52: X0930099511406200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 10634.11: X0930099511360200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 11049.24: X0930099511410200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 11815.68: X0930099511330200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 12230.80: X0930099511297200806051137_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 12997.25: X0930099511372200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 13412.37: X0930099511476200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 14178.81: X0930099511444200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 14593.94: X0930099511488200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 15360.38: X0930099511427200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 15775.51: X0930099511473200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 16541.95: X0930099511353200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 16957.08: X0930099511420200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 17723.52: X0930099511396200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 18138.64: X0930099511466200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 18905.08: X0930099511446200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 19320.21: X0930099511401200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 20086.65: X0930099511327200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 20501.78: X0930099511303200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 21268.22: X0930099511494200806051134_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 21683.35: X0930099511312200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 22449.79: X0930099511391200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 22864.91: X0930099511389200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 23631.36: X0930099511392200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 24046.48: X0930099511381200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 24812.92: X0930099511464200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 25228.05: X0930099511483200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 25994.49: X0930099511439200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 26409.62: X0930099511487200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 27176.06: X0930099511416200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 27591.19: X0930099511500200806051134_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 28357.63: X0930099511434200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 28772.75: X0930099511328200806051137_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 29539.19: X0930099511452200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 29954.32: X0930099511336200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 30720.76: X0930099511443200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 31135.89: X0930099511457200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 31902.33: X0930099511310200806051137_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 32317.46: X0930099511356200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 33083.90: X0930099511405200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 33499.02: X0930099511342200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 34265.47: X0930099511417200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 34680.59: X0930099511321200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 35447.03: X0930099511373200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 35862.16: X0930099511287200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 36628.60: X0930099511364200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 37043.73: X0930099511485200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 37810.17: X0930099511332200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 38225.30: X0930099511478200806051135_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 38991.74: X0930099511424200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 39406.86: X0930099511317200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 40173.30: X0930099511468200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 40588.43: X0930099511433200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 41354.87: X0930099511428200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 41770.00: X0930099511361200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 42536.44: X0930099511430200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 42951.57: X0930099511307200806051137_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 43718.01: X0930099511376200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 44133.13: X0930099511370200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 44899.58: X0930099511291200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 45314.70: X0930099511388200806051136_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 46081.14: X0930099511462200806051135_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 46496.27: X0930099511293200806051138_0 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| SETI@home \| [rr_sim] 47262.71: ap_24oc12ab_B5_P0_00050_20130106_25020.wu_0 finishes (579358.98G/15.66G) 15/1/2013 8:53:04 \| World Community Grid \| [rr_sim] 47528.70: X0930099511384200806051136_1 finishes (25495.01G/21.58G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 47677.84: MindModeling-279-50f482126ebaf_0 finishes (23032.64G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f482126ebaf_0 misses deadline by 32848.69 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 48446.54: MindModeling-279-50f4954a49b1a_0 finishes (23032.64G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954a49b1a_0 misses deadline by 28832.52 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 49364.38: collatz_2378086850039686867304_103079215104_0 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 50132.68: MindModeling-279-50f4954a1d813_0 finishes (57376.45G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954a1d813_0 misses deadline by 31118.94 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 51650.80: collatz_2378086837670181054824_103079215104_0 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 53002.64: MindModeling-279-50f4954a723a6_0 finishes (75300.56G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954a723a6_0 misses deadline by 34119.63 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 54651.48: collatz_2378130805490908375400_103079215104_0 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 55872.61: MindModeling-279-50f4954a9f630_0 finishes (80422.14G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954a9f630_0 misses deadline by 37324.41 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 57856.26: collatz_2378130807655571892584_103079215104_1 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 58742.57: collatz_2378130807552492677480_103079215104_0 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 61612.53: MindModeling-279-50f4954ac922a_0 finishes (94337.10G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4954ac922a_0 misses deadline by 41083.69 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 61615.54: collatz_2378130805387829160296_103079215104_1 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| Cosmology@Home \| [rr_sim] 64482.50: wu_011313_163116_3_0_0 finishes (163195.72G/2.51G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 65032.59: MindModeling-279-50f49e4188ced_0 finishes (94337.10G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e4188ced_0 misses deadline by 41948.97 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 65374.82: collatz_2378130807758651107688_103079215104_1 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| Cosmology@Home \| [rr_sim] 67352.46: wu_011313_163131_1_1_0 finishes (169229.50G/2.51G) 15/1/2013 8:53:04 \| Cosmology@Home \| [rr_sim] 67437.02: wu_011313_201605_0_0_0 finishes (169258.35G/2.51G) 15/1/2013 8:53:04 \| Cosmology@Home \| [rr_sim] 67448.52: wu_011313_201604_2_0_0 finishes (169258.35G/2.51G) 15/1/2013 8:53:04 \| Cosmology@Home \| [rr_sim] 67448.52: wu_011313_201604_2_1_0 finishes (169258.35G/2.51G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 67448.52: MindModeling-279-50f49e41ad85c_0 finishes (94337.10G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e41ad85c_0 misses deadline by 45366.02 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 68791.87: MindModeling-279-50f49e41d6131_0 finishes (94337.10G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e41d6131_0 misses deadline by 45708.25 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 69134.10: collatz_2378130805593987590504_103079215104_0 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 70222.43: MindModeling-279-50f49e413f32c_0 finishes (94337.10G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e413f32c_0 misses deadline by 47770.45 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 71196.30: MindModeling-279-50f49e4163c94_0 finishes (94337.10G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f49e4163c94_0 misses deadline by 47781.95 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] 71207.80: MindModeling-279-50f4a0a545897_0 finishes (94337.10G/25.09G) 15/1/2013 8:53:04 \| MindModeling@Beta \| [rr_sim] MindModeling-279-50f4a0a545897_0 misses deadline by 47534.95 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 71207.80: poempp_anticancer_aurein_1358049165_465841097_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 73608.15: poempp_anticancer_aurein_1358049164_691345986_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 73950.38: poempp_anticancer_aurein_1358049165_1852562564_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 76012.58: poempp_anticancer_aurein_1358049166_1260141213_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 76024.07: poempp_anticancer_aurein_1358049166_163313666_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 76024.07: poempp_anticancer_aurein_1358049159_1305964167_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 78424.42: poempp_anticancer_aurein_1358049157_1658442024_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 78766.65: collatz_2378130787348966517096_824633720832_1 finishes (1537437.31G/86.50G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 79387.39: poempp_anticancer_aurein_1358049159_1468760754_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 80828.85: poempp_anticancer_aurein_1358049161_1524715615_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 80840.34: poempp_anticancer_aurein_1358049163_1768422218_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 80840.34: collatz_2378132473828004833640_103079215104_0 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 82257.35: poempp_anticancer_aurein_1358049157_1202789532_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 83240.69: poempp_anticancer_aurein_1358049161_1268625719_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 83582.92: poempp_anticancer_aurein_1358049163_1503956672_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 85645.12: poempp_anticancer_aurein_1358049157_2021110191_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 85656.62: poempp_anticancer_aurein_1358049159_124314130_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 85656.62: poempp_anticancer_aurein_1358049158_1590278216_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 88056.97: poempp_anticancer_aurein_1358049157_301753657_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 88399.20: collatz_2378130788173600237928_824633720832_0 finishes (1699376.62G/86.50G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 89869.52: collatz_2378130727047625681256_824633720832_0 finishes (1699376.62G/86.50G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 89869.52: collatz_2378130765186935269736_824633720832_0 finishes (1699376.62G/86.50G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 89869.52: collatz_2378132512998106573160_824633720832_0 finishes (1699376.62G/86.50G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 89869.52: poempp_anticancer_aurein_1358049154_29679182_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 90461.39: poempp_anticancer_aurein_1358049165_147056271_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Poem@Home \| [rr_sim] 90472.89: poempp_anticancer_aurein_1358049162_600610906_0 finishes (192000.00G/39.86G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 90472.89: collatz_2378132473724925618536_103079215104_0 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 92739.48: collatz_2378132501040917621096_103079215104_1 finishes (212422.08G/74.02G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 99209.45: collatz_2378132542272603662696_824633720832_1 finishes (1699376.62G/86.50G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 112704.44: collatz_2378132555879060056424_824633720832_1 finishes (1699376.62G/86.50G) 15/1/2013 8:53:04 \| Collatz Conjecture \| [rr_sim] 115256.54: collatz_2378132541447969941864_824633720832_0 finishes (1699376.62G/86.50G) 15/1/2013 8:53:04 \| climateprediction.net \| [rr_sim] 1259138.65: hadcm3n_o2aw_2140_40_008269826_3 finishes (3087600.07G/2.58G) 15/1/2013 8:53:04 \| \| [work_fetch] buffer_low: no; sim_excluded_instances 0 15/1/2013 8:53:04 \| \| [work_fetch] buffer_low: no; sim_excluded_instances 0 15/1/2013 8:53:04 \| \| [work_fetch] ------- start work fetch state ------- 15/1/2013 8:53:04 \| \| [work_fetch] target work buffer: 86400.00 + 3456.00 sec 15/1/2013 8:53:04 \| Poem@Home \| [work_fetch] REC 2697.128 priority -0.732183 15/1/2013 8:53:04 \| Collatz Conjecture \| [work_fetch] REC 10364.709 priority -11.370130 15/1/2013 8:53:04 \| climateprediction.net \| [work_fetch] REC 264.820 priority -0.227774 (project backoff 2093.06) 15/1/2013 8:53:04 \| MindModeling@Beta \| [work_fetch] REC 86.774 priority -0.060579 15/1/2013 8:53:04 \| SETI@home \| [work_fetch] REC 720.070 priority -0.081790 (project backoff 6770.61) 15/1/2013 8:53:04 \| Cosmology@Home \| [work_fetch] REC 751.113 priority -0.194472 15/1/2013 8:53:04 \| World Community Grid \| [work_fetch] REC 6563.368 priority -1.442397 15/1/2013 8:53:04 \| \| [work_fetch] CPU: shortfall 3255.84 nidle 0.00 saturated 88056.97 busy 4677.12 15/1/2013 8:53:04 \| Poem@Home \| [work_fetch] CPU: fetch share 0.238 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| Collatz Conjecture \| [work_fetch] CPU: fetch share 0.048 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| climateprediction.net \| [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| MindModeling@Beta \| [work_fetch] CPU: fetch share 0.238 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| SETI@home \| [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| Cosmology@Home \| [work_fetch] CPU: fetch share 0.238 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| World Community Grid \| [work_fetch] CPU: fetch share 0.238 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| \| [work_fetch] ATI: shortfall 0.00 nidle 0.00 saturated 95609.45 busy 0.00 15/1/2013 8:53:04 \| Poem@Home \| [work_fetch] ATI: fetch share 0.313 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| Collatz Conjecture \| [work_fetch] ATI: fetch share 0.063 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| climateprediction.net \| [work_fetch] ATI: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| MindModeling@Beta \| [work_fetch] ATI: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00) (no apps) 15/1/2013 8:53:04 \| SETI@home \| [work_fetch] ATI: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| Cosmology@Home \| [work_fetch] ATI: fetch share 0.313 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| World Community Grid \| [work_fetch] ATI: fetch share 0.313 rsc backoff (dt 0.00, inc 0.00) 15/1/2013 8:53:04 \| \| [work_fetch] ------- end work fetch state ------- 15/1/2013 8:53:04 \| \| [work_fetch] No project chosen for work fetch 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] Process for MindModeling-279-50f482126ebaf_0 exited, exit code 0, task state 1 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] task_state=EXITED for MindModeling-279-50f482126ebaf_0 from handle_exited_app 15/1/2013 8:53:29 \| \| [cpu_sched_debug] Request CPU reschedule: application exited 15/1/2013 8:53:29 \| \| [work_fetch] Request work fetch: application exited 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] Process for MindModeling-279-50f4954a49b1a_0 exited, exit code 0, task state 1 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] task_state=EXITED for MindModeling-279-50f4954a49b1a_0 from handle_exited_app 15/1/2013 8:53:29 \| \| [cpu_sched_debug] Request CPU reschedule: application exited 15/1/2013 8:53:29 \| \| [work_fetch] Request work fetch: application exited 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] Process for MindModeling-279-50f4954a1d813_0 exited, exit code 0, task state 1 15/1/2013 8:53:29 \| MindModeling@Beta \| Task MindModeling-279-50f4954a1d813_0 exited with zero status but no 'finished' file 15/1/2013 8:53:29 \| MindModeling@Beta \| If this happens repeatedly you may need to reset the project. 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] task_state=UNINITIALIZED for MindModeling-279-50f4954a1d813_0 from handle_premature_exit 15/1/2013 8:53:29 \| \| [cpu_sched_debug] Request CPU reschedule: application exited 15/1/2013 8:53:29 \| \| [work_fetch] Request work fetch: application exited 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] Process for MindModeling-279-50f4954a723a6_0 exited, exit code 0, task state 1 15/1/2013 8:53:29 \| MindModeling@Beta \| Task MindModeling-279-50f4954a723a6_0 exited with zero status but no 'finished' file 15/1/2013 8:53:29 \| MindModeling@Beta \| If this happens repeatedly you may need to reset the project. 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] task_state=UNINITIALIZED for MindModeling-279-50f4954a723a6_0 from handle_premature_exit 15/1/2013 8:53:29 \| \| [cpu_sched_debug] Request CPU reschedule: application exited 15/1/2013 8:53:29 \| \| [work_fetch] Request work fetch: application exited 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] Process for MindModeling-279-50f4954a9f630_0 exited, exit code 0, task state 1 15/1/2013 8:53:29 \| MindModeling@Beta \| Task MindModeling-279-50f4954a9f630_0 exited with zero status but no 'finished' file 15/1/2013 8:53:29 \| MindModeling@Beta \| If this happens repeatedly you may need to reset the project. 15/1/2013 8:53:29 \| MindModeling@Beta \| [task] task_state=UNINITIALIZED for MindModeling-279-50f4954a9f630_0 from handle_premature_exit [---3---] 15/1/2013 11:35:55 \| MindModeling@Beta \| [task] Process for MindModeling-279-50f4aee14029b_0 exited, exit code 0, task state 1 15/1/2013 11:35:55 \| MindModeling@Beta \| [task] task_state=EXITED for MindModeling-279-50f4aee14029b_0 from handle_exited_app 15/1/2013 11:35:55 \| \| [cpu_sched_debug] Request CPU reschedule: application exited 15/1/2013 11:35:55 \| \| [work_fetch] Request work fetch: application exited 15/1/2013 11:35:55 \| MindModeling@Beta \| Computation for task MindModeling-279-50f4aee14029b_0 finished 15/1/2013 11:35:55 \| MindModeling@Beta \| [task] result state=FILES_UPLOADING for MindModeling-279-50f4aee14029b_0 from CS::app_finished 15/1/2013 11:35:55 \| \| [cpu_sched_debug] Request CPU reschedule: handle_finished_apps 15/1/2013 11:35:55 \| \| [cpu_sched_debug] Request CPU reschedule: periodic CPU scheduling 15/1/2013 11:35:55 \| \| [cpu_sched_debug] schedule_cpus(): start 15/1/2013 11:35:55 \| \| [rr_sim] start: work_buf min 60480 additional 3456 total 63936 on_frac 0.987 active_frac 0.999 15/1/2013 11:35:55 \| World Community Grid \| [rr_sim] 0.00: X0930099511429200806051136_1 finishes (6461.07G/21.59G) 15/1/2013 11:35:55 \| World Community Grid \| [rr_sim] 299.29: X0930099511497200806051134_1 finishes (25495.01G/21.59G) 15/1/2013 11:35:55 \| World Community Grid \| [rr_sim] 1180.98: X0930099511346200806051137_0 finishes (25495.01G/21.59G) 15/1/2013 11:35:55 \| World Community Grid \| [rr_sim] 1480.27: X0930099511451200806051135_0 finishes (25495.01G/21.59G) 15/1/2013 11:35:55 \| World Community Grid \| [rr_sim] 2361.96: X0930099511411200806051136_0 finishes (25495.01G/21.59G) 15/1/2013 11:35:55 \| World Community Grid \| [rr_sim] 2661.25: X0930099511461200806051135_0 finishes (25495.01G/21.59G) 15/1/2013 11:35:55 \| World Community Grid \| [rr_sim ID: 47274 ·

Jord Volunteer tester Help desk expert Send message Joined: 29 Aug 05 Posts: 15480	Message 47275 - Posted: 15 Jan 2013, 15:48:34 UTC Please update to BOINC 7.0.42 or 7.0.44, then try again. These versions have a newer detection in case it's the client that dies unexpectedly. There's also new code that will kill the application if it is hung up for 10 seconds or more. ID: 47275 ·

kdsjsdj Send message Joined: 5 Jan 13 Posts: 81	Message 47294 - Posted: 15 Jan 2013, 22:17:50 UTC - in response to Message 47274. I suspect what is happening here is that BOINC is too busy with itself running time estimations to notice the WUs prodding it for attention. That proves you grasp the concept but when I look at the times in the log snippets you posted all the estimation operations are stamped with 8:43:21 so it appears the time estimations seem to take only 1 second or less. I'm not 100% sure but I think the apps are not that impatient. IIRC, they check for a heartbeat from BOINC client every 60 seconds. ID: 47294 ·

Joe Bloggs Send message Joined: 6 Jan 13 Posts: 40	Message 47298 - Posted: 16 Jan 2013, 8:15:14 UTC - in response to Message 47275. Ageless, I'd upgraded back up to .42 when this happened. Speaking of heartbeat, here's the stderr from the crashed CPDN WU: <core_client_version>7.0.42</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:11:14 (4080): Can't acquire lockfile (32) - waiting 35s 00:11:19 (7496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:38:20 (8224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:21 (8224): No heartbeat from core client for 30 sec - exiting 06:38:22 (8224): No heartbeat from core client for 30 sec - exiting 06:38:23 (8224): No heartbeat from core client for 30 sec - exiting 06:38:24 (8224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:54:20 (8800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:35:15 (8244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:20 (860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:39:09 (8268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:28:29 (8804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:39 (8804): No heartbeat from core client for 30 sec - exiting 00:28:40 (8804): No heartbeat from core client for 30 sec - exiting 00:28:42 (8804): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:56:02 (8824): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:36:16 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:20 (4224): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]> Does this tell you anything? :S ID: 47298 ·

Jord Volunteer tester Help desk expert Send message Joined: 29 Aug 05 Posts: 15480	Message 47299 - Posted: 16 Jan 2013, 8:26:31 UTC - in response to Message 47298. No, but then you haven't really answered yet whether you checked anything off the list I posted in this post either. Or that you checked at CPDN to see if you're the only one and what they say could be causing it. But I see that you did and that you gave info there that you didn't give us. Looking at the log it appears the error occurred when BOINC tried to suspend the task while I was away from my computer. Doesn't seem like there's any reason for it to do so except for the scheduled project switching so I've set the project switching interval to 99999 minutes (1666 hours), hopefully long enough for one project to finish running in one go barring any computer downtime. There's also the "Suspend work if CPU usage is above x%" preference that can do that, as well as the "Suspend work if no mouse/keyboard activity in last x minutes". So please, when you give information over on the project forums, give us that info as well. It's common courtesy. Unless you expect of us to scour all project forums for snippets of information. For which I just don't have the time, to be honest. ID: 47299 ·

Joe Bloggs Send message Joined: 6 Jan 13 Posts: 40	Message 47302 - Posted: 16 Jan 2013, 9:42:33 UTC - in response to Message 47299. ... on balance I think I've given more information here than at cpdn.net but I'll try to reduplicate everything next time... But actually looking at the logs, the CPDN WU last "exited with zero" at ~11:36 and I think I was actually at the computer that time. So the "extra info" given at CPDN may not even be correct. 1. Make sure you exclude the BOINC directory and all subdirectories (or the BOINC Data directory and all subdirectories in BOINC 6 and 7) from being actively scanned by anti-virus and anti-spyware software. Only scan when you have exited BOINC. 4. Disable Drive Indexing. Done. (drive indexing disabled for the drive on which BOINC program and data files reside) 3. Don't run Scandisk with BOINC on. 5. Update your motherboard chipset drivers, specifically those for your IDE or SATA controllers. 7. When you use use BOINC's CPU throttling function, you can run into the too many exit(0)s error. The advice here is to disable the BOINC throttling (set it to 100%) and reduce the amount of CPUs/cores for BOINC to use. ** Use at most 100.0 percent of CPU time. * In BOINC 7.0, this is done through the option On multiprocessors, use at most xxx% of the processors. 3. I only run chkdsk after a system crash. That never happened within this time frame. 5. I'd done that before installing BOINC 7. I'd discovered for myself before that limiting number of cores used (I have 6 available) improved performance much better than throttling did. 2. Don't defrag your disk with BOINC on. 6. Disable the Time synchronization in Windows XP/Vista. Normally found under the clock (double click it in the system tray), third tab (Internet in English), uncheck the sync option. I'd run into a problem before (stuttering audio when using ASIO) for which the solutions proposed ranged from the pedestrian to the ludicrous, like disabling almost every windows service. Eventually I solved the problem but I don't even know what I did that solved it. I'd disabled almost every startup item and now MSN Messenger wouldn't run. ... these last 2 suggestions sound like extreme measures to me. Defrag is scheduled to run once a week; how do I tell BOINC to stop running while this is happening? And are you telling me that I can't even have the luxury of knowing that my computer clock is accurate if I want to run BOINC reliably? Care to explain how time synchronization relates to this problem? Anyway, it's been over 24 hours and I haven't had an exit with zero error since the CPDN WU died. I don't know what I changed that solved the problem; I didn't act on (1) and (4) until a few hours ago, and BOINC had been running flawlessly for several hours by then; perhaps CPDN was the cause of the errors, and its WU crashing out "solved" the problem; or perhaps it was this discovery that fixed things: before, when I set the GPU to "run always", the computer would be very unresponsive when I'm at the keyboard, to the extent that sometimes I couldn't even open BOINC manager to stop the GPU for want of the GUI responding for whole minutes at a time. The last error occurred about the time when I applied the TThrottle "fix". I can't be sure whether it was before or after the fix though. ID: 47302 ·

kdsjsdj Send message Joined: 5 Jan 13 Posts: 81	Message 47307 - Posted: 16 Jan 2013, 11:18:21 UTC - in response to Message 47302. Last modified: 16 Jan 2013, 11:20:35 UTC ... these last 2 suggestions sound like extreme measures to me. Defrag is scheduled to run once a week; how do I tell BOINC to stop running while this is happening? A weekly defrag is more than most people need but if that's what you want then go for it. It sounds like you're running the defrag via Event Scheduler, if so then I would create a .bat file that: 1) shuts BOINC down 2) runs the defrag 3) runs a virus scan 4) other misc. weekly maintenance 5) re-starts BOINC Then run that .bat in Event Scheduler. The BOINC service can be stopped with the net command, not sure if it's "net BOINC stop" or "net stop BOINC" but you'll figure it out. And it might be boinc-client instead of BOINC. You can start the BOINC service with "net start". Again you'll have to experiment to find the correct syntax. And are you telling me that I can't even have the luxury of knowing that my computer clock is accurate if I want to run BOINC reliably? Care to explain how time synchronization relates to this problem? If your clock lags behind a fair bit and many do, we've found this out through experience, then when it syncs it makes the science apps think they haven't received a heartbeat from client for more than whatever the limit is. In fact the limit hasn't been exceeded it's just that the clock jumped ahead a large amount. See what I mean? This is a well known cause, confirmed and verified many a time. Some people with clocks that lag a lot find that slipping a new battery in cures the problem. Others find that resyncing just once a day instead of evry 5 minutes or so cures the problem. Yah, they still get a "exit with finished file" but it happens only once per day instead of every 5 minutes. Anyway, it's been over 24 hours and I haven't had an exit with zero error since the CPDN WU died. Well then it seems to me the CPDN wu was the cause or somehow connected to the cause. I don't know what I changed that solved the problem; I didn't act on (1) and (4) until a few hours ago, and BOINC had been running flawlessly for several hours by then; perhaps CPDN was the cause of the errors, and its WU crashing out "solved" the problem; or perhaps it was this discovery that fixed things: before, when I set the GPU to "run always", the computer would be very unresponsive when I'm at the keyboard, to the extent that sometimes I couldn't even open BOINC manager to stop the GPU for want of the GUI responding for whole minutes at a time. The last error occurred about the time when I applied the TThrottle "fix". I can't be sure whether it was before or after the fix though. hehe you've got your work cut out for you. I can't put my finger on the problem for you but I can tell you some methods that work for me when things get as complicated as your situation: 1) assume NOTHING, don't say "it can't be that" until you've tested and verified 2) reduce complexity by running only 1 project for a few days or even a week, if everything goes well then add another project, run the 2 for a week, add another and so on... if you add project X back into the mix and that's when your troubles reappear then it's likely X or something related to X so then set your other projects to No New Tasks and run just X, maybe start with just 1 X task, then 2, then 3... ID: 47307 ·

Richard Haselgrove Volunteer tester Help desk expert Send message Joined: 5 Oct 06 Posts: 5080	Message 47309 - Posted: 16 Jan 2013, 11:49:52 UTC - in response to Message 47307. The BOINC service can be stopped with the net command, not sure if it's "net BOINC stop" or "net stop BOINC" but you'll figure it out. And it might be boinc-client instead of BOINC. You can start the BOINC service with "net start". Again you'll have to experiment to find the correct syntax. That only works if BOINC is running in 'daemon' or service mode. The OP has told us it's running in 'user' mode: 13/1/2013 12:00:48 \| \| Running under account User The stop/restart can still be achieved with a batch file, but you'd need to find the boinccmd tool and invoke that - I probably have some code I could dig out. ID: 47309 ·

kdsjsdj Send message Joined: 5 Jan 13 Posts: 81	Message 47310 - Posted: 16 Jan 2013, 12:18:39 UTC - in response to Message 47309. Doh! Right, user mode. The net command won't work, use boinccmd.exe instead for stopping and then invoke boinc.exe to restart. If your binaries are in c:\program files\boinc' then use "c:\program files\boinc\boinccmd" --passwd <password> --quit to stop the client and "c:\program files\boinc" --detach to start it. <password> is found in the file gui_rpc_auth.cfg in the BOINC data dir which is c:\programdata\boinc\ by default. ID: 47310 ·

Joe Bloggs Send message Joined: 6 Jan 13 Posts: 40	Message 47314 - Posted: 16 Jan 2013, 16:29:30 UTC Well, today was defrag day, and defrag hour passed by without incident. But later in the day I started getting these zero exit errors again. Another few things I'm wondering about: 1. I had started running the ASIO audio application I talked about in my last post. This had to be run as a Realtime priority application in order to get any reliability at all. Maybe that's the problem? It uses very little CPU time though and I did not notice any impact on system response using it before installing BOINC. I'm an audiophile before I'm a BOINCer and I have to run this app just to get any sound out of my computer so... I'd closed and restarted BOINC to do some of my own troubleshooting and now I can't see the old log entries. I know they're kept in a file somewhere but what's it called? 2. One of the lines in the stderr for the failed CPDN task mentioned not being able to get a lock on a file. I went to my ProgramData directory and noted in its Properties that Read-Only was marked with a square, which if I understand correctly means that some items inside had been marked read-only... so I cleared the checkbox, told windows to make the change (to writeable) to all files in the directory and subdirectories... but when I opened its properties again, the checkbox was marked with a square again... I opened a command line and did "dir . /s /ar" to look for any files marked read-only and came up blank though. While I'm at it, let's mention a little fiasco I had a while ago: a few days ago, before I knew about 7.0.42, I was experimenting with GPU allocation and wanted my video card to be recognized as having a count of 2 to get more WUs running on it at the same time. I edited the relevant count entry in client_state.xml. This of course didn't do anything while BOINC was running, and when I closed and restarted BOINC the proper count of 1 of course reasserted itself. In a bout of frustration (what did I have to lose, right? I was just horsing around with a new hobby) I set client_state.xml to read-only. Immediately all kinds of sh!t started going down. Connecting to BOINC client took forever. Event log complains of not being able to update the client state every time anything happened. I closed BOINC and unchecked the read-only attribute but for some reason it wouldn't stick. BOINC kept making the same complaints. I messed with the security settings trying to grant everyone full control and that wouldn't stick either. Finally, in a panic, I deleted client_state.xml and client_state_prev.xml. That didn't go well, of course: all the job data was lost and BOINC started downloading all-new tasks. Finally I restored the xml files, and somehow when I selected both files at the same time and unchecked the read-only property in the property box for the group selection, the change stuck and BOINC recovered. Now, I don't know what lasting damage might have resulted from my shenanigans... :S 3. Speaking of permissions, I was surprised to find, in the properties for the folder ProgramData\BOINC, that there were a bunch of underprivileged users. Only "boinc_admins" had anything near full control (which was all the permissions checked: modify, read & execute, list folder contents, read, write) except for "full control" and "special permissions". Neither boinc_users nor boinc_projects had modify or write permissions, and one of them (I don't remember which, I think it was boinc_projects) had NO permissions at all. I've since edited all these boinc users to get all the permissions I could grant (which was every tick, including "full control", except "special permissions".) Was what I saw normal? Or do they need these permissions I just granted them? Or are those non-permissions normal safeguards that I should restore? I've also set BOINC and boincmgr to run as administrator, and, in a random punt at the "no heartbeat for 30 seconds" problem, given boinc.exe Realtime thread priority. I'll leave BOINC and my audio program running overnight and see how it goes. :S :S ID: 47314 ·

Joe Bloggs Send message Joined: 6 Jan 13 Posts: 40	Message 47316 - Posted: 16 Jan 2013, 17:42:46 UTC - in response to Message 47314. From the log: 16-Jan-2013 20:19:58 [MindModeling@Beta] [task] Process for MindModeling-279-50f690bd5c5e7_0 exited, exit code 0, task state 1 16-Jan-2013 20:19:58 [MindModeling@Beta] Task MindModeling-279-50f690bd5c5e7_0 exited with zero status but no 'finished' file From the corresponding stderr of the (thankfully finished) WU: Beginning run at 20:13:09 Starting model with IV vector: 5.0 2.3500 0.89375 0.06400 0.04020:20:28 (5676): No heartbeat from core client for 30 sec - exiting wrapper: starting 20:21:12 (6164): wrapper: running ../../projects/mindmodeling.org/1.88_windows_intelx86_ccl.exe (-I ccl.image -l letf.lisp -b -- windows_intelx86 mm_config_file.txt in.txt) Note that the time 20:20:28 is 30 seconds AFTER the log declares that the WU had exited. WTF? ID: 47316 ·

kdsjsdj Send message Joined: 5 Jan 13 Posts: 81	Message 47323 - Posted: 16 Jan 2013, 20:39:39 UTC - in response to Message 47314. Well, today was defrag day, and defrag hour passed by without incident. You were lucky that time. Next time you might not be. Another few things I'm wondering about: 1. I had started running the ASIO audio application I talked about in my last post. This had to be run as a Realtime priority application in order to get any reliability at all. Maybe that's the problem? It uses very little CPU time though and I did not notice any impact on system response using it before installing BOINC. I'm an audiophile before I'm a BOINCer and I have to run this app just to get any sound out of my computer so... I'm a Linux user so not fully aware of all the implications of "Realtime priority application" but I would say there is a good chance it's blocking BOINC. You have the ASIO app, the chances of anybody else here having it is slim so YOU are the one who needs to test and verify. If the problems occur only when ASIO runs then you've found the problem. In that case you can specify ASIO as an exclusive app in cc_config.xml which will cause BOINC to automatically suspend whenever ASIO runs and resume whenever ASIO is not running. I'd closed and restarted BOINC to do some of my own troubleshooting and now I can't see the old log entries. I know they're kept in a file somewhere but what's it called? .../BOINC/stdoutdae.txt 2. One of the lines in the stderr for the failed CPDN task mentioned not being able to get a lock on a file. I went to my ProgramData directory and noted in its Properties that Read-Only was marked with a square, which if I understand correctly means that some items inside had been marked read-only... so I cleared the checkbox, told windows to make the change (to writeable) to all files in the directory and subdirectories... but when I opened its properties again, the checkbox was marked with a square again... I opened a command line and did "dir . /s /ar" to look for any files marked read-only and came up blank though. That kind of crap rarely happens on Linux (hint, hint) While I'm at it, let's mention a little fiasco I had a while ago: If you're worried about it then wipe the slate clean and restart: uninstall BOINC, delete ../../BOINC/, reinstall 3. Speaking of permissions Mess around with that stuff and you're on your own. Nobody here wants to second-guess what you did or did not do and what effect that might or might not have. The permissions work. Don't mess with them. Same with client_state.xml... best just leave it alone unless you really know what you're doing. ID: 47323 ·

kdsjsdj Send message Joined: 5 Jan 13 Posts: 81	Message 47324 - Posted: 16 Jan 2013, 20:41:08 UTC - in response to Message 47316. WTF? +1 ID: 47324 ·

Jord Volunteer tester Help desk expert Send message Joined: 29 Aug 05 Posts: 15480	Message 47325 - Posted: 16 Jan 2013, 20:49:36 UTC - in response to Message 47314. I went to my ProgramData directory and noted in its Properties that Read-Only was marked with a square, which if I understand correctly means that some items inside had been marked read-only... No, it's Windows way of securing the directory. Despite that it says that the read-only mark only applies to files in the folder, it's actually only the folder that has the read-only attribute checked, not (necessarily) any of the files therein. I set client_state.xml to read-only. Client_state.xml is the main sanity file for BOINC, where it stores all the relevant information about the projects you added, the programs you downloaded from them and the tasks you got. This file is written to several times per minute. Actually, it's being read by BOINC, the actual client_state.xml it read is renamed to client_state_prev.xml, then a new client_state.xml is written in which the updated information is written, before that cycle repeats itself. The client_state_prev.xml file is a backup in case something goes awry that corrupts the client_state.xml file or the data within. By setting the file to read-only, BOINC couldn't write to it anymore (although it can rename it, if I am not mistaken), giving you all the trouble. Only "boinc_admins" had anything near full control (which was all the permissions checked: modify, read & execute, list folder contents, read, write) except for "full control" and "special permissions". Neither boinc_users nor boinc_projects had modify or write permissions, and one of them (I don't remember which, I think it was boinc_projects) had NO permissions at all. They don't need it. boinc_admins: Members of this group can change the configuration and protection settings for the BOINC client (for example the GUI RPC password and host list) and can also run the BOINC Manager and screensaver. boinc_users: Members of this group can run the BOINC Manager and screensaver. boinc_projects: Is a workaround for a deficiency in the Microsoft Installer (MSI). See http://boinc.berkeley.edu/trac/wiki/ClientSetupLogicWinSix#Datadirectory and http://boinc.berkeley.edu/trac/wiki/ClientSetupLogicWinSix#Executablesdirectory for who has what permission. ID: 47325 ·

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.