Posts by Jimmy G (BA)

1) Message boards : Questions and problems : Long Post - BM Spontaneous Restart (Message 43603)
Posted 19 Apr 2012 by Jimmy G (BA)
Post:
6-Week Final Update:...looks like BOINC Manager 6.12.43 has solved all of my issues with spontaneous restarts, waiting for gpu statuses and mdnsresponder system freezes...yay!...

...seeing how 6.12.35 was not playing well with OSX 10.6.8, perhaps the kind folks at BOINC would consider elevating 6.12.43 as their preferred v.6 OSX install on this page?...

Download BOINC client software:
http://boinc.berkeley.edu/download_all.php

...and again, my sincere thanks to everyone for all your time, help, insights and suggestions!... :)
2) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 43602)
Posted 19 Apr 2012 by Jimmy G (BA)
Post:
6-Week Final Update:...looks like BOINC Manager 6.12.43 has solved all of my issues with spontaneous restarts, waiting for gpu statuses and mdnsresponder system freezes...yay!...

...seeing how 6.12.35 was not playing well with OSX 10.6.8, perhaps the kind folks at BOINC would consider elevating 6.12.43 as their preferred v.6 OSX install on this page?...

Download BOINC client software:
http://boinc.berkeley.edu/download_all.php

...and again, my sincere thanks to everyone for all your time, help, insights and suggestions!... :)
3) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42779)
Posted 28 Feb 2012 by Jimmy G (BA)
Post:
Resolution Update: Looks like the problem was identified as a narrow Mac OSX 10.6.8 BOINC 6.12.34/35 issue which was cleared with BOINC 6.12.41 as noted here...

"WU Freezes BOINC Manager" Redux...:
http://milkyway.cs.rpi.edu/milkyway/forum_thread.php?id=2789&nowrap=true#53464

...thanks Kashi and scasady for figuring this out! Also thanks to everyone at MWAH & BOINC who spent time with me trying to solve this!

Oh, happy day,
:)
4) Message boards : Questions and problems : Long Post - BM Spontaneous Restart (Message 42778)
Posted 28 Feb 2012 by Jimmy G (BA)
Post:
Resolution Update: Looks like the problem was identified as a narrow Mac OSX 10.6.8 BOINC 6.12.34/35 issue which was cleared with BOINC 6.12.41 as noted here...

"WU Freezes BOINC Manager" Redux...:
http://milkyway.cs.rpi.edu/milkyway/forum_thread.php?id=2789&nowrap=true#53464

...thanks Kashi and scasady for figuring this out! Also thanks to everyone at MWAH & BOINC who spent time with me trying to solve this!

Oh, happy day,
:)
5) Message boards : Questions and problems : Long Post - BM Spontaneous Restart (Message 42288)
Posted 27 Jan 2012 by Jimmy G (BA)
Post:
Hi Jimmy, as Charlie said in your other thread, BOINC 6.12 is no longer updated, so anything happening in it won't be followed up on.

All concentration is on BOINC 7 (latest at time of posting this is 7.0.12), so if you want to try if you can get similar results there, then the developers will be thrilled... and not, of course, as it means more bugs to squash. ;-)


Hi Jord,

I did note that Charlie mentioned the focus being on the newer version. However he also expressed interest in a few of the other issues I was encountering...

Message: 42273
http://boinc.berkeley.edu/dev/forum_thread.php?id=7212&nowrap=true#42273

My concerns are the several other issues you have raised, such as the md5 errors, spontaneous restarts, etc.


...where I subsequently let him know I was working on compiling the info for an overnight crash/restart (not the one that this thread is addressing) that had occurred. And, hence, this report.

If, what you're saying, that it's official that 6.12.35 is being/currently EOLed then I have no problem just forgoing any further error reporting...frees up time on both our ends... :)

Question, then, should I forward these MWAH issues over to their board?

As I also mentioned to Charlie, being a v.7 alpha tester appears to require a bit more time than I can currently afford to lend...hopefully my time situation will improve sometime over the summer...in the meantime I continue to monitor the alpha mailing list to get a better handle on what will be required when the time comes... :)

Best,
:)
6) Message boards : Questions and problems : Long Post - BM Spontaneous Restart (Message 42284)
Posted 27 Jan 2012 by Jimmy G (BA)
Post:
Just experienced another episode of BOINC Manager Spontaneous Restart. This particular episode was immediately preceded by MWAH WU nbody-Plum_Embedded_7583087_0 crashing and burning with a Computation Error as noted in BM Status. BOINC Manager went into a quit and then spontaneously restarted about 1-minute later. (See timeline below)

If you folks need any other info, kindly let me know (I can pull up the syslog if needed).

:)

iMac 12,2 3.4GHz i7 2600k 16GB (No usable GPU) Mac 10.6.8 BOINC 6.12.35

Task 84138423: nbody-Plum_Embedded_7583087_0
http://milkyway.cs.rpi.edu/milkyway/result.php?resultid=84138423

stderr.txt
Stderr output

<core_client_version>6.12.35</core_client_version>
<![CDATA[
<message>
process exited with code 13 (0xd, -243)
</message>
<stderr_txt>
Error loading Lua script 'astronomy_parameters.txt': [string "number_parameters: 4..."]:1: '<name>' expected near '4'
Error reading astronomy parameters from file 'astronomy_parameters.txt'
Trying old parameters file
Using SSE3 path
11:43:00 (38265): No heartbeat from core client for 30 sec - exiting
<search_application> milkyway_nbody 0.84 Darwin x86_64 double OpenMP, Crlibm </search_application>
Using OpenMP 8 max threads on a system with 8 processors
Opening Lua script 'nbody_parameters.lua' (2): No such file or directory
Failed to read input parameters file
11:44:11 (38296): called boinc_finish

</stderr_txt>
]]>

BOINC Log File

I took a clip from stdoutdae.txt from when the system was last stable until it crashed and cleared and returned to stable. Train wreck here...


27-Jan-2012 11:39:36 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2472067_0 checkpointed
27-Jan-2012 11:39:36 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2472066_0 checkpointed
27-Jan-2012 11:39:37 [Milkyway@Home] [task] result ps_separation_82_2s_mix1_2_5539894_0 checkpointed
27-Jan-2012 11:39:37 [Milkyway@Home] [task] result ps_separation_82_2s_mix0_3_2484294_0 checkpointed
27-Jan-2012 11:39:37 [Milkyway@Home] [task] result ps_separation_82_2s_mix0_3_2484292_0 checkpointed
27-Jan-2012 11:39:37 [Milkyway@Home] [task] result ps_separation_82_2s_mix0_3_2484291_0 checkpointed
27-Jan-2012 11:39:42 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482898_0 checkpointed
27-Jan-2012 11:39:42 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482890_0 checkpointed
27-Jan-2012 11:40:00 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix2_3_2472067_0 exited
27-Jan-2012 11:40:00 [Milkyway@Home] [task] task_state=EXITED for ps_separation_82_2s_mix2_3_2472067_0 from handle_exited_app
27-Jan-2012 11:40:00 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:40:00 [Milkyway@Home] Computation for task ps_separation_82_2s_mix2_3_2472067_0 finished
27-Jan-2012 11:40:00 [Milkyway@Home] [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix2_3_2472067_0 from CS::app_finished
27-Jan-2012 11:40:00 [Milkyway@Home] [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix2_3_2472067_0 from CS::update_results
27-Jan-2012 11:40:00 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38153
27-Jan-2012 11:40:00 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2212143_0 from start
27-Jan-2012 11:40:00 [Milkyway@Home] Restarting task ps_separation_82_2s_mix2_3_2212143_0 using milkyway version 82
27-Jan-2012 11:40:01 [Milkyway@Home] Sending scheduler request: To fetch work.
27-Jan-2012 11:40:01 [Milkyway@Home] Reporting 1 completed tasks, requesting new tasks for CPU
27-Jan-2012 11:40:02 [Milkyway@Home] Scheduler request completed: got 1 new tasks
27-Jan-2012 11:40:02 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7572621_1 from handle_scheduler_reply
27-Jan-2012 11:40:03 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7572621_1 from CS::update_results
27-Jan-2012 11:40:04 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7572621_1 from CS::update_results
27-Jan-2012 11:40:35 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix2_3_2212143_0 exited
27-Jan-2012 11:40:35 [Milkyway@Home] Task ps_separation_82_2s_mix2_3_2212143_0 exited with zero status but no 'finished' file
27-Jan-2012 11:40:35 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:40:35 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2212143_0 from handle_premature_exit
27-Jan-2012 11:40:35 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:40:35 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2212143_0 from temporary exit
27-Jan-2012 11:40:35 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38159
27-Jan-2012 11:40:35 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix1_2_5269588_0 from start
27-Jan-2012 11:40:35 [Milkyway@Home] Restarting task ps_separation_82_2s_mix1_2_5269588_0 using milkyway version 82
27-Jan-2012 11:40:36 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2472066_0 checkpointed
27-Jan-2012 11:40:37 [Milkyway@Home] [task] result ps_separation_82_2s_mix1_2_5539894_0 checkpointed
27-Jan-2012 11:40:37 [Milkyway@Home] [task] result ps_separation_82_2s_mix0_3_2484294_0 checkpointed
27-Jan-2012 11:40:37 [Milkyway@Home] [task] result ps_separation_82_2s_mix0_3_2484292_0 checkpointed
27-Jan-2012 11:40:37 [Milkyway@Home] [task] result ps_separation_82_2s_mix0_3_2484291_0 checkpointed
27-Jan-2012 11:40:42 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482898_0 checkpointed
27-Jan-2012 11:40:42 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482890_0 checkpointed
27-Jan-2012 11:40:47 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix0_3_2484291_0 exited
27-Jan-2012 11:40:47 [Milkyway@Home] [task] task_state=EXITED for ps_separation_82_2s_mix0_3_2484291_0 from handle_exited_app
27-Jan-2012 11:40:47 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:40:47 [Milkyway@Home] Computation for task ps_separation_82_2s_mix0_3_2484291_0 finished
27-Jan-2012 11:40:47 [Milkyway@Home] [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix0_3_2484291_0 from CS::app_finished
27-Jan-2012 11:40:47 [Milkyway@Home] [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix0_3_2484291_0 from CS::update_results
27-Jan-2012 11:40:47 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38163
27-Jan-2012 11:40:47 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix0_3_2213973_0 from start
27-Jan-2012 11:40:47 [Milkyway@Home] Restarting task ps_separation_82_2s_mix0_3_2213973_0 using milkyway version 82
27-Jan-2012 11:40:48 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix0_3_2484294_0 exited
27-Jan-2012 11:40:48 [Milkyway@Home] [task] task_state=EXITED for ps_separation_82_2s_mix0_3_2484294_0 from handle_exited_app
27-Jan-2012 11:40:48 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:40:48 [Milkyway@Home] Computation for task ps_separation_82_2s_mix0_3_2484294_0 finished
27-Jan-2012 11:40:48 [Milkyway@Home] [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix0_3_2484294_0 from CS::app_finished
27-Jan-2012 11:40:48 [Milkyway@Home] [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix0_3_2484294_0 from CS::update_results
27-Jan-2012 11:40:48 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38164
27-Jan-2012 11:40:48 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix3_3_2213578_0 from start
27-Jan-2012 11:40:48 [Milkyway@Home] Restarting task ps_separation_82_2s_mix3_3_2213578_0 using milkyway version 82
27-Jan-2012 11:40:49 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix1_2_5539894_0 exited
27-Jan-2012 11:40:49 [Milkyway@Home] [task] task_state=EXITED for ps_separation_82_2s_mix1_2_5539894_0 from handle_exited_app
27-Jan-2012 11:40:49 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:40:49 [Milkyway@Home] Computation for task ps_separation_82_2s_mix1_2_5539894_0 finished
27-Jan-2012 11:40:49 [Milkyway@Home] [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix1_2_5539894_0 from CS::app_finished
27-Jan-2012 11:40:49 [Milkyway@Home] [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix1_2_5539894_0 from CS::update_results
27-Jan-2012 11:40:49 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38165
27-Jan-2012 11:40:49 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix4_3_2167426_2 from start
27-Jan-2012 11:40:49 [Milkyway@Home] Restarting task ps_separation_82_2s_mix4_3_2167426_2 using milkyway version 82
27-Jan-2012 11:40:50 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix2_3_2482898_0 exited
27-Jan-2012 11:40:50 [Milkyway@Home] [task] task_state=EXITED for ps_separation_82_2s_mix2_3_2482898_0 from handle_exited_app
27-Jan-2012 11:40:50 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:40:50 [Milkyway@Home] Computation for task ps_separation_82_2s_mix2_3_2482898_0 finished
27-Jan-2012 11:40:50 [Milkyway@Home] [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix2_3_2482898_0 from CS::app_finished
27-Jan-2012 11:40:50 [Milkyway@Home] [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix2_3_2482898_0 from CS::update_results
27-Jan-2012 11:40:50 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38166
27-Jan-2012 11:40:50 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_coadd_2_2216702_0 from start
27-Jan-2012 11:40:50 [Milkyway@Home] Restarting task ps_separation_82_2s_coadd_2_2216702_0 using milkyway version 82
27-Jan-2012 11:40:51 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix0_3_2484292_0 exited
27-Jan-2012 11:40:51 [Milkyway@Home] [task] task_state=EXITED for ps_separation_82_2s_mix0_3_2484292_0 from handle_exited_app
27-Jan-2012 11:40:51 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:40:51 [Milkyway@Home] Computation for task ps_separation_82_2s_mix0_3_2484292_0 finished
27-Jan-2012 11:40:51 [Milkyway@Home] [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix0_3_2484292_0 from CS::app_finished
27-Jan-2012 11:40:51 [Milkyway@Home] [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix0_3_2484292_0 from CS::update_results
27-Jan-2012 11:40:51 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38167
27-Jan-2012 11:40:51 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2219069_1 from start
27-Jan-2012 11:40:51 [Milkyway@Home] Restarting task ps_separation_82_2s_mix2_3_2219069_1 using milkyway version 82
27-Jan-2012 11:40:52 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix2_3_2472066_0 exited
27-Jan-2012 11:40:52 [Milkyway@Home] [task] task_state=EXITED for ps_separation_82_2s_mix2_3_2472066_0 from handle_exited_app
27-Jan-2012 11:40:52 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:40:52 [Milkyway@Home] Computation for task ps_separation_82_2s_mix2_3_2472066_0 finished
27-Jan-2012 11:40:52 [Milkyway@Home] [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix2_3_2472066_0 from CS::app_finished
27-Jan-2012 11:40:52 [Milkyway@Home] [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix2_3_2472066_0 from CS::update_results
27-Jan-2012 11:40:52 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38172
27-Jan-2012 11:40:52 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482889_0 from start
27-Jan-2012 11:40:52 [Milkyway@Home] Starting task ps_separation_82_2s_mix2_3_2482889_0 using milkyway version 82
27-Jan-2012 11:40:54 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix2_3_2482890_0 exited
27-Jan-2012 11:40:54 [Milkyway@Home] [task] task_state=EXITED for ps_separation_82_2s_mix2_3_2482890_0 from handle_exited_app
27-Jan-2012 11:40:54 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:40:54 [Milkyway@Home] Computation for task ps_separation_82_2s_mix2_3_2482890_0 finished
27-Jan-2012 11:40:54 [Milkyway@Home] [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix2_3_2482890_0 from CS::app_finished
27-Jan-2012 11:40:54 [Milkyway@Home] [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix2_3_2482890_0 from CS::update_results
27-Jan-2012 11:40:54 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38177
27-Jan-2012 11:40:54 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482888_0 from start
27-Jan-2012 11:40:54 [Milkyway@Home] Starting task ps_separation_82_2s_mix2_3_2482888_0 using milkyway version 82
27-Jan-2012 11:41:07 [Milkyway@Home] Sending scheduler request: To fetch work.
27-Jan-2012 11:41:07 [Milkyway@Home] Reporting 7 completed tasks, requesting new tasks for CPU
27-Jan-2012 11:41:08 [Milkyway@Home] Scheduler request completed: got 7 new tasks
27-Jan-2012 11:41:08 [Milkyway@Home] [task] result state=NEW for ps_separation_82_2s_mix4_3_2494141_0 from handle_scheduler_reply
27-Jan-2012 11:41:08 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7583104_0 from handle_scheduler_reply
27-Jan-2012 11:41:08 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7583087_0 from handle_scheduler_reply
27-Jan-2012 11:41:08 [Milkyway@Home] [task] result state=NEW for ps_separation_82_2s_mix3_3_2494394_0 from handle_scheduler_reply
27-Jan-2012 11:41:08 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7583088_0 from handle_scheduler_reply
27-Jan-2012 11:41:08 [Milkyway@Home] [task] result state=NEW for ps_separation_82_2s_mix4_3_2494151_0 from handle_scheduler_reply
27-Jan-2012 11:41:08 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7583109_0 from handle_scheduler_reply
27-Jan-2012 11:41:09 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix4_3_2494151_0 from CS::update_results
27-Jan-2012 11:41:09 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix4_3_2494141_0 from CS::update_results
27-Jan-2012 11:41:09 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix3_3_2494394_0 from CS::update_results
27-Jan-2012 11:41:09 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7583109_0 from CS::update_results
27-Jan-2012 11:41:09 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7583104_0 from CS::update_results
27-Jan-2012 11:41:09 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7583088_0 from CS::update_results
27-Jan-2012 11:41:09 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7583087_0 from CS::update_results
27-Jan-2012 11:41:10 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix1_2_5269588_0 exited
27-Jan-2012 11:41:10 [Milkyway@Home] Task ps_separation_82_2s_mix1_2_5269588_0 exited with zero status but no 'finished' file
27-Jan-2012 11:41:10 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:41:10 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix1_2_5269588_0 from handle_premature_exit
27-Jan-2012 11:41:10 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:41:10 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix1_2_5269588_0 from temporary exit
27-Jan-2012 11:41:10 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix4_3_2494151_0 from CS::update_results
27-Jan-2012 11:41:10 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix4_3_2494141_0 from CS::update_results
27-Jan-2012 11:41:10 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix3_3_2494394_0 from CS::update_results
27-Jan-2012 11:41:10 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7583109_0 from CS::update_results
27-Jan-2012 11:41:10 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7583104_0 from CS::update_results
27-Jan-2012 11:41:10 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7583088_0 from CS::update_results
27-Jan-2012 11:41:10 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7583087_0 from CS::update_results
27-Jan-2012 11:41:10 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38186
27-Jan-2012 11:41:10 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482887_0 from start
27-Jan-2012 11:41:10 [Milkyway@Home] Starting task ps_separation_82_2s_mix2_3_2482887_0 using milkyway version 82
27-Jan-2012 11:41:22 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix0_3_2213973_0 exited
27-Jan-2012 11:41:22 [Milkyway@Home] Task ps_separation_82_2s_mix0_3_2213973_0 exited with zero status but no 'finished' file
27-Jan-2012 11:41:22 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix0_3_2213973_0 from handle_premature_exit
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix0_3_2213973_0 from temporary exit
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix3_3_2213578_0 from suspend
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix4_3_2167426_2 from suspend
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_coadd_2_2216702_0 from suspend
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix2_3_2219069_1 from suspend
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix2_3_2482889_0 from suspend
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix2_3_2482888_0 from suspend
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix2_3_2482887_0 from suspend
27-Jan-2012 11:41:22 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38194
27-Jan-2012 11:41:22 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7567511_0 from start
27-Jan-2012 11:41:22 [Milkyway@Home] Starting task nbody-Plum_Embedded_7567511_0 using milkyway_nbody version 84
27-Jan-2012 11:41:23 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix3_3_2213578_0 exited
27-Jan-2012 11:41:23 [Milkyway@Home] Task ps_separation_82_2s_mix3_3_2213578_0 exited with zero status but no 'finished' file
27-Jan-2012 11:41:23 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:41:23 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix3_3_2213578_0 from handle_premature_exit
27-Jan-2012 11:41:23 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:41:23 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix3_3_2213578_0 from temporary exit
27-Jan-2012 11:41:24 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix4_3_2167426_2 exited
27-Jan-2012 11:41:24 [Milkyway@Home] Task ps_separation_82_2s_mix4_3_2167426_2 exited with zero status but no 'finished' file
27-Jan-2012 11:41:24 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:41:24 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix4_3_2167426_2 from handle_premature_exit
27-Jan-2012 11:41:24 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:41:24 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix4_3_2167426_2 from temporary exit
27-Jan-2012 11:41:25 [Milkyway@Home] [task] Process for ps_separation_82_2s_coadd_2_2216702_0 exited
27-Jan-2012 11:41:25 [Milkyway@Home] Task ps_separation_82_2s_coadd_2_2216702_0 exited with zero status but no 'finished' file
27-Jan-2012 11:41:25 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:41:25 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_coadd_2_2216702_0 from handle_premature_exit
27-Jan-2012 11:41:25 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:41:25 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_coadd_2_2216702_0 from temporary exit
27-Jan-2012 11:41:26 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix2_3_2219069_1 exited
27-Jan-2012 11:41:26 [Milkyway@Home] Task ps_separation_82_2s_mix2_3_2219069_1 exited with zero status but no 'finished' file
27-Jan-2012 11:41:26 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:41:26 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2219069_1 from handle_premature_exit
27-Jan-2012 11:41:26 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:41:26 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2219069_1 from temporary exit
27-Jan-2012 11:41:28 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7567511_0 exited
27-Jan-2012 11:41:28 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7567511_0 from handle_exited_app
27-Jan-2012 11:41:28 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:41:28 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7567511_0 finished
27-Jan-2012 11:41:28 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7567511_0 from CS::app_finished
27-Jan-2012 11:41:28 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7567511_0 from CS::update_results
27-Jan-2012 11:41:28 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38200
27-Jan-2012 11:41:28 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7567507_0 from start
27-Jan-2012 11:41:28 [Milkyway@Home] Starting task nbody-Plum_Embedded_7567507_0 using milkyway_nbody version 84
27-Jan-2012 11:41:34 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7567507_0 exited
27-Jan-2012 11:41:34 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7567507_0 from handle_exited_app
27-Jan-2012 11:41:34 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:41:34 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7567507_0 finished
27-Jan-2012 11:41:34 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7567507_0 from CS::app_finished
27-Jan-2012 11:41:34 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7567507_0 from CS::update_results
27-Jan-2012 11:41:34 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38208
27-Jan-2012 11:41:34 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7567501_0 from start
27-Jan-2012 11:41:34 [Milkyway@Home] Starting task nbody-Plum_Embedded_7567501_0 using milkyway_nbody version 84
27-Jan-2012 11:41:40 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7567501_0 exited
27-Jan-2012 11:41:40 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7567501_0 from handle_exited_app
27-Jan-2012 11:41:40 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:41:40 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7567501_0 finished
27-Jan-2012 11:41:40 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7567501_0 from CS::app_finished
27-Jan-2012 11:41:40 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7567501_0 from CS::update_results
27-Jan-2012 11:41:40 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38214
27-Jan-2012 11:41:40 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7567500_0 from start
27-Jan-2012 11:41:40 [Milkyway@Home] Starting task nbody-Plum_Embedded_7567500_0 using milkyway_nbody version 84
27-Jan-2012 11:41:46 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7567500_0 exited
27-Jan-2012 11:41:46 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7567500_0 from handle_exited_app
27-Jan-2012 11:41:46 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:41:46 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7567500_0 finished
27-Jan-2012 11:41:46 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7567500_0 from CS::app_finished
27-Jan-2012 11:41:46 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7567500_0 from CS::update_results
27-Jan-2012 11:41:46 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38220
27-Jan-2012 11:41:46 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7567499_0 from start
27-Jan-2012 11:41:46 [Milkyway@Home] Starting task nbody-Plum_Embedded_7567499_0 using milkyway_nbody version 84
27-Jan-2012 11:41:52 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7567499_0 exited
27-Jan-2012 11:41:52 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7567499_0 from handle_exited_app
27-Jan-2012 11:41:52 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:41:52 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7567499_0 finished
27-Jan-2012 11:41:52 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7567499_0 from CS::app_finished
27-Jan-2012 11:41:52 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7567499_0 from CS::update_results
27-Jan-2012 11:41:52 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38228
27-Jan-2012 11:41:52 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7567494_0 from start
27-Jan-2012 11:41:52 [Milkyway@Home] Starting task nbody-Plum_Embedded_7567494_0 using milkyway_nbody version 84
27-Jan-2012 11:41:58 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7567494_0 exited
27-Jan-2012 11:41:58 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7567494_0 from handle_exited_app
27-Jan-2012 11:41:58 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:41:58 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7567494_0 finished
27-Jan-2012 11:41:58 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7567494_0 from CS::app_finished
27-Jan-2012 11:41:58 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7567494_0 from CS::update_results
27-Jan-2012 11:41:58 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38235
27-Jan-2012 11:41:58 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7572621_1 from start
27-Jan-2012 11:41:58 [Milkyway@Home] Starting task nbody-Plum_Embedded_7572621_1 using milkyway_nbody version 84
27-Jan-2012 11:42:04 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7572621_1 exited
27-Jan-2012 11:42:04 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7572621_1 from handle_exited_app
27-Jan-2012 11:42:04 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:42:04 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7572621_1 finished
27-Jan-2012 11:42:04 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7572621_1 from CS::app_finished
27-Jan-2012 11:42:04 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7572621_1 from CS::update_results
27-Jan-2012 11:42:04 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38240
27-Jan-2012 11:42:04 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7583109_0 from start
27-Jan-2012 11:42:04 [Milkyway@Home] Starting task nbody-Plum_Embedded_7583109_0 using milkyway_nbody version 84
27-Jan-2012 11:42:10 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7583109_0 exited
27-Jan-2012 11:42:10 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7583109_0 from handle_exited_app
27-Jan-2012 11:42:10 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:42:10 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7583109_0 finished
27-Jan-2012 11:42:10 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7583109_0 from CS::app_finished
27-Jan-2012 11:42:10 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7583109_0 from CS::update_results
27-Jan-2012 11:42:10 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38247
27-Jan-2012 11:42:10 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7583104_0 from start
27-Jan-2012 11:42:10 [Milkyway@Home] Starting task nbody-Plum_Embedded_7583104_0 using milkyway_nbody version 84
27-Jan-2012 11:42:13 [Milkyway@Home] Sending scheduler request: To fetch work.
27-Jan-2012 11:42:13 [Milkyway@Home] Reporting 8 completed tasks, requesting new tasks for CPU
27-Jan-2012 11:42:15 [Milkyway@Home] Scheduler request completed: got 8 new tasks
27-Jan-2012 11:42:15 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7583186_0 from handle_scheduler_reply
27-Jan-2012 11:42:15 [Milkyway@Home] [task] result state=NEW for ps_separation_82_2s_mix1_2_5498121_1 from handle_scheduler_reply
27-Jan-2012 11:42:15 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7583246_0 from handle_scheduler_reply
27-Jan-2012 11:42:15 [Milkyway@Home] [task] result state=NEW for ps_separation_82_2s_mix1_2_5547402_1 from handle_scheduler_reply
27-Jan-2012 11:42:15 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7583247_0 from handle_scheduler_reply
27-Jan-2012 11:42:15 [Milkyway@Home] [task] result state=NEW for ps_separation_82_2s_mix1_3_2487122_1 from handle_scheduler_reply
27-Jan-2012 11:42:15 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7583271_0 from handle_scheduler_reply
27-Jan-2012 11:42:15 [Milkyway@Home] [task] result state=NEW for ps_separation_82_2s_mix1_3_2491539_1 from handle_scheduler_reply
27-Jan-2012 11:42:16 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7583104_0 exited
27-Jan-2012 11:42:16 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7583104_0 from handle_exited_app
27-Jan-2012 11:42:16 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:42:16 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7583104_0 finished
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7583104_0 from CS::app_finished
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7583104_0 from CS::update_results
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_3_2491539_1 from CS::update_results
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_3_2487122_1 from CS::update_results
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_2_5547402_1 from CS::update_results
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_2_5498121_1 from CS::update_results
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7583271_0 from CS::update_results
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7583247_0 from CS::update_results
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7583246_0 from CS::update_results
27-Jan-2012 11:42:16 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7583186_0 from CS::update_results
27-Jan-2012 11:42:16 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38252
27-Jan-2012 11:42:16 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7583088_0 from start
27-Jan-2012 11:42:16 [Milkyway@Home] Starting task nbody-Plum_Embedded_7583088_0 using milkyway_nbody version 84
27-Jan-2012 11:42:17 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_3_2491539_1 from CS::update_results
27-Jan-2012 11:42:17 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_3_2487122_1 from CS::update_results
27-Jan-2012 11:42:17 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_2_5547402_1 from CS::update_results
27-Jan-2012 11:42:17 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_2_5498121_1 from CS::update_results
27-Jan-2012 11:42:17 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7583271_0 from CS::update_results
27-Jan-2012 11:42:17 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7583247_0 from CS::update_results
27-Jan-2012 11:42:17 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7583246_0 from CS::update_results
27-Jan-2012 11:42:17 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7583186_0 from CS::update_results
27-Jan-2012 11:42:22 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7583088_0 exited
27-Jan-2012 11:42:22 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7583088_0 from handle_exited_app
27-Jan-2012 11:42:22 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:42:22 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7583088_0 finished
27-Jan-2012 11:42:22 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7583088_0 from CS::app_finished
27-Jan-2012 11:42:22 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7583088_0 from CS::update_results
27-Jan-2012 11:42:22 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38259
27-Jan-2012 11:42:22 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7583087_0 from start
27-Jan-2012 11:42:22 [Milkyway@Home] Starting task nbody-Plum_Embedded_7583087_0 using milkyway_nbody version 84
27-Jan-2012 11:42:29 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7583087_0 exited
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7583087_0 from handle_exited_app
27-Jan-2012 11:42:29 [Milkyway@Home] [task] process exited with status 0
27-Jan-2012 11:42:29 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7583087_0 finished
27-Jan-2012 11:42:29 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7583087_0 from CS::app_finished
27-Jan-2012 11:42:29 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7583087_0 from CS::update_results
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482889_0 from unsuspend
27-Jan-2012 11:42:29 [Milkyway@Home] Resuming task ps_separation_82_2s_mix2_3_2482889_0 using milkyway version 82
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482888_0 from unsuspend
27-Jan-2012 11:42:29 [Milkyway@Home] Resuming task ps_separation_82_2s_mix2_3_2482888_0 using milkyway version 82
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482887_0 from unsuspend
27-Jan-2012 11:42:29 [Milkyway@Home] Resuming task ps_separation_82_2s_mix2_3_2482887_0 using milkyway version 82
27-Jan-2012 11:42:29 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38265
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix4_3_2494151_0 from start
27-Jan-2012 11:42:29 [Milkyway@Home] Starting task ps_separation_82_2s_mix4_3_2494151_0 using milkyway version 82
27-Jan-2012 11:42:29 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38270
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix4_3_2494141_0 from start
27-Jan-2012 11:42:29 [Milkyway@Home] Starting task ps_separation_82_2s_mix4_3_2494141_0 using milkyway version 82
27-Jan-2012 11:42:29 [Milkyway@Home] Failed to open init file slots/17/init_data.xml
27-Jan-2012 11:42:29 [Milkyway@Home] Signature verification error for milkyway_separation_0.82_x86_64-apple-darwin
27-Jan-2012 11:42:29 [Milkyway@Home] [task] result state=COMPUTE_ERROR for ps_separation_82_2s_mix3_3_2494394_0 from CS::report_result_error
27-Jan-2012 11:42:29 [Milkyway@Home] [task] couldn't start app: Can't write init file: -108
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=COULDNT_START for ps_separation_82_2s_mix3_3_2494394_0 from start
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=COULDNT_START for ps_separation_82_2s_mix3_3_2494394_0 from resume_or_start1
27-Jan-2012 11:42:29 [Milkyway@Home] Failed to open init file slots/19/init_data.xml
27-Jan-2012 11:42:29 [Milkyway@Home] [task] result state=COMPUTE_ERROR for ps_separation_82_2s_mix1_3_2491539_1 from CS::report_result_error
27-Jan-2012 11:42:29 [Milkyway@Home] [task] couldn't start app: Can't write init file: -108
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=COULDNT_START for ps_separation_82_2s_mix1_3_2491539_1 from start
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=COULDNT_START for ps_separation_82_2s_mix1_3_2491539_1 from resume_or_start1
27-Jan-2012 11:42:29 [Milkyway@Home] Failed to open init file slots/20/init_data.xml
27-Jan-2012 11:42:29 [Milkyway@Home] [task] result state=COMPUTE_ERROR for ps_separation_82_2s_mix1_3_2487122_1 from CS::report_result_error
27-Jan-2012 11:42:29 [Milkyway@Home] [task] couldn't start app: Can't write init file: -108
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=COULDNT_START for ps_separation_82_2s_mix1_3_2487122_1 from start
27-Jan-2012 11:42:29 [Milkyway@Home] [task] task_state=COULDNT_START for ps_separation_82_2s_mix1_3_2487122_1 from resume_or_start1
27-Jan-2012 11:42:29 [---] Can't open client_state_next.xml: fopen() failed
27-Jan-2012 11:42:29 [---] Couldn't write state file: fopen() failed; giving up
27-Jan-2012 11:43:34 [---] Starting BOINC client version 6.12.35 for x86_64-apple-darwin
27-Jan-2012 11:43:34 [---] log flags: file_xfer, sched_ops, task, task_debug
27-Jan-2012 11:43:34 [---] Libraries: libcurl/7.19.7 OpenSSL/0.9.7l zlib/1.2.3 c-ares/1.6.0
27-Jan-2012 11:43:34 [---] Data directory: /Library/Application Support/BOINC Data
27-Jan-2012 11:43:34 [---] Processor: 8 GenuineIntel Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz [x86 Family 6 Model 42 Stepping 7]
27-Jan-2012 11:43:34 [---] Processor features: FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 PCLMULQDQ DTES64 MON DSCPL VMX SMX EST TM2 SSSE3 CX16 TPR PDCM SSE4.1 SSE4.2 xAPIC POPCNT AES XSAVE OSXSAVE PCID TSCTMR AVX1.0
27-Jan-2012 11:43:34 [---] OS: Mac OS X 10.6.8 (Darwin 10.8.0)
27-Jan-2012 11:43:34 [---] Memory: 16.00 GB physical, 362.33 GB virtual
27-Jan-2012 11:43:34 [---] Disk: 465.75 GB total, 362.09 GB free
27-Jan-2012 11:43:34 [---] Local time is UTC -5 hours
27-Jan-2012 11:43:34 [---] No usable GPUs found
27-Jan-2012 11:43:34 [climateprediction.net] URL http://climateprediction.net/; Computer ID 1171126; resource share 100
27-Jan-2012 11:43:34 [Milkyway@Home] URL http://milkyway.cs.rpi.edu/milkyway/; Computer ID 330727; resource share 100
27-Jan-2012 11:43:34 [SETI@home] URL http://setiathome.berkeley.edu/; Computer ID 6180003; resource share 100
27-Jan-2012 11:43:34 [climateprediction.net] General prefs: from climateprediction.net (last modified 16-Dec-2011 23:45:19)
27-Jan-2012 11:43:34 [climateprediction.net] Host location: none
27-Jan-2012 11:43:34 [climateprediction.net] General prefs: using your defaults
27-Jan-2012 11:43:34 [---] Reading preferences override file
27-Jan-2012 11:43:34 [---] Preferences:
27-Jan-2012 11:43:34 [---] max memory usage when active: 12288.00MB
27-Jan-2012 11:43:34 [---] max memory usage when idle: 14745.60MB
27-Jan-2012 11:43:34 [---] max disk usage: 100.00GB
27-Jan-2012 11:43:34 [---] don't use GPU while active
27-Jan-2012 11:43:34 [---] suspend work if non-BOINC CPU load exceeds 25 %
27-Jan-2012 11:43:34 [---] (to change preferences, visit the web site of an attached project, or select Preferences in the Manager)
27-Jan-2012 11:43:34 [---] Not using a proxy
Initialization completed
27-Jan-2012 11:43:34 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38280
27-Jan-2012 11:43:34 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2212143_0 from start
27-Jan-2012 11:43:34 [Milkyway@Home] Restarting task ps_separation_82_2s_mix2_3_2212143_0 using milkyway version 82
27-Jan-2012 11:43:34 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38281
27-Jan-2012 11:43:34 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix1_2_5269588_0 from start
27-Jan-2012 11:43:34 [Milkyway@Home] Restarting task ps_separation_82_2s_mix1_2_5269588_0 using milkyway version 82
27-Jan-2012 11:43:34 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38282
27-Jan-2012 11:43:34 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix0_3_2213973_0 from start
27-Jan-2012 11:43:34 [Milkyway@Home] Restarting task ps_separation_82_2s_mix0_3_2213973_0 using milkyway version 82
27-Jan-2012 11:43:34 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38283
27-Jan-2012 11:43:34 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix3_3_2213578_0 from start
27-Jan-2012 11:43:34 [Milkyway@Home] Restarting task ps_separation_82_2s_mix3_3_2213578_0 using milkyway version 82
27-Jan-2012 11:43:34 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38284
27-Jan-2012 11:43:34 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix4_3_2167426_2 from start
27-Jan-2012 11:43:34 [Milkyway@Home] Restarting task ps_separation_82_2s_mix4_3_2167426_2 using milkyway version 82
27-Jan-2012 11:43:34 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38285
27-Jan-2012 11:43:34 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_coadd_2_2216702_0 from start
27-Jan-2012 11:43:34 [Milkyway@Home] Restarting task ps_separation_82_2s_coadd_2_2216702_0 using milkyway version 82
27-Jan-2012 11:43:34 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38286
27-Jan-2012 11:43:34 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2219069_1 from start
27-Jan-2012 11:43:34 [Milkyway@Home] Restarting task ps_separation_82_2s_mix2_3_2219069_1 using milkyway version 82
27-Jan-2012 11:43:34 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38287
27-Jan-2012 11:43:34 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482889_0 from start
27-Jan-2012 11:43:34 [Milkyway@Home] Restarting task ps_separation_82_2s_mix2_3_2482889_0 using milkyway version 82
27-Jan-2012 11:43:34 [Milkyway@Home] Sending scheduler request: To fetch work.
27-Jan-2012 11:43:34 [Milkyway@Home] Reporting 2 completed tasks, requesting new tasks for CPU
27-Jan-2012 11:43:35 [Milkyway@Home] Scheduler request completed: got 2 new tasks
27-Jan-2012 11:43:35 [Milkyway@Home] [task] result state=NEW for nbody-Plum_Embedded_7583350_0 from handle_scheduler_reply
27-Jan-2012 11:43:35 [Milkyway@Home] [task] result state=NEW for ps_separation_82_2s_mix2_3_2493610_0 from handle_scheduler_reply
27-Jan-2012 11:43:36 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix2_3_2493610_0 from CS::update_results
27-Jan-2012 11:43:36 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7583350_0 from CS::update_results
27-Jan-2012 11:43:37 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix2_3_2493610_0 from CS::update_results
27-Jan-2012 11:43:37 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7583350_0 from CS::update_results
27-Jan-2012 11:44:09 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix2_3_2219069_1 exited
27-Jan-2012 11:44:09 [Milkyway@Home] Task ps_separation_82_2s_mix2_3_2219069_1 exited with zero status but no 'finished' file
27-Jan-2012 11:44:09 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:44:09 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2219069_1 from handle_premature_exit
27-Jan-2012 11:44:09 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:44:09 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2219069_1 from temporary exit
27-Jan-2012 11:44:09 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38293
27-Jan-2012 11:44:09 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482888_0 from start
27-Jan-2012 11:44:09 [Milkyway@Home] Restarting task ps_separation_82_2s_mix2_3_2482888_0 using milkyway version 82
27-Jan-2012 11:44:10 [Milkyway@Home] [task] Process for ps_separation_82_2s_coadd_2_2216702_0 exited
27-Jan-2012 11:44:10 [Milkyway@Home] Task ps_separation_82_2s_coadd_2_2216702_0 exited with zero status but no 'finished' file
27-Jan-2012 11:44:10 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:44:10 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_coadd_2_2216702_0 from handle_premature_exit
27-Jan-2012 11:44:10 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:44:10 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_coadd_2_2216702_0 from temporary exit
27-Jan-2012 11:44:10 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38295
27-Jan-2012 11:44:10 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482887_0 from start
27-Jan-2012 11:44:10 [Milkyway@Home] Restarting task ps_separation_82_2s_mix2_3_2482887_0 using milkyway version 82
27-Jan-2012 11:44:11 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix4_3_2167426_2 exited
27-Jan-2012 11:44:11 [Milkyway@Home] Task ps_separation_82_2s_mix4_3_2167426_2 exited with zero status but no 'finished' file
27-Jan-2012 11:44:11 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix4_3_2167426_2 from handle_premature_exit
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix4_3_2167426_2 from temporary exit
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix2_3_2212143_0 from suspend
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix1_2_5269588_0 from suspend
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix0_3_2213973_0 from suspend
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix3_3_2213578_0 from suspend
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix2_3_2482889_0 from suspend
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix2_3_2482888_0 from suspend
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=SUSPENDED for ps_separation_82_2s_mix2_3_2482887_0 from suspend
27-Jan-2012 11:44:11 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38296
27-Jan-2012 11:44:11 [Milkyway@Home] [task] task_state=EXECUTING for nbody-Plum_Embedded_7583087_0 from start
27-Jan-2012 11:44:11 [Milkyway@Home] Restarting task nbody-Plum_Embedded_7583087_0 using milkyway_nbody version 84
27-Jan-2012 11:44:12 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix3_3_2213578_0 exited
27-Jan-2012 11:44:12 [Milkyway@Home] Task ps_separation_82_2s_mix3_3_2213578_0 exited with zero status but no 'finished' file
27-Jan-2012 11:44:12 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:44:12 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix3_3_2213578_0 from handle_premature_exit
27-Jan-2012 11:44:12 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:44:12 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix3_3_2213578_0 from temporary exit
27-Jan-2012 11:44:13 [Milkyway@Home] [task] Process for nbody-Plum_Embedded_7583087_0 exited
27-Jan-2012 11:44:13 [Milkyway@Home] [task] task_state=EXITED for nbody-Plum_Embedded_7583087_0 from handle_exited_app
27-Jan-2012 11:44:13 [Milkyway@Home] [task] result state=COMPUTE_ERROR for nbody-Plum_Embedded_7583087_0 from CS::report_result_error
27-Jan-2012 11:44:13 [Milkyway@Home] [task] process exited with status 13
27-Jan-2012 11:44:13 [Milkyway@Home] Computation for task nbody-Plum_Embedded_7583087_0 finished
27-Jan-2012 11:44:13 [Milkyway@Home] [task] result state=COMPUTE_ERROR for nbody-Plum_Embedded_7583087_0 from CS::app_finished
27-Jan-2012 11:44:13 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2212143_0 from unsuspend
27-Jan-2012 11:44:13 [Milkyway@Home] Resuming task ps_separation_82_2s_mix2_3_2212143_0 using milkyway version 82
27-Jan-2012 11:44:13 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix1_2_5269588_0 from unsuspend
27-Jan-2012 11:44:13 [Milkyway@Home] Resuming task ps_separation_82_2s_mix1_2_5269588_0 using milkyway version 82
27-Jan-2012 11:44:13 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix0_3_2213973_0 from unsuspend
27-Jan-2012 11:44:13 [Milkyway@Home] Resuming task ps_separation_82_2s_mix0_3_2213973_0 using milkyway version 82
27-Jan-2012 11:44:13 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482889_0 from unsuspend
27-Jan-2012 11:44:13 [Milkyway@Home] Resuming task ps_separation_82_2s_mix2_3_2482889_0 using milkyway version 82
27-Jan-2012 11:44:13 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482888_0 from unsuspend
27-Jan-2012 11:44:13 [Milkyway@Home] Resuming task ps_separation_82_2s_mix2_3_2482888_0 using milkyway version 82
27-Jan-2012 11:44:13 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2482887_0 from unsuspend
27-Jan-2012 11:44:13 [Milkyway@Home] Resuming task ps_separation_82_2s_mix2_3_2482887_0 using milkyway version 82
27-Jan-2012 11:44:13 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38303
27-Jan-2012 11:44:13 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix4_3_2494151_0 from start
27-Jan-2012 11:44:13 [Milkyway@Home] Starting task ps_separation_82_2s_mix4_3_2494151_0 using milkyway version 82
27-Jan-2012 11:44:13 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38308
27-Jan-2012 11:44:13 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix4_3_2494141_0 from start
27-Jan-2012 11:44:13 [Milkyway@Home] Starting task ps_separation_82_2s_mix4_3_2494141_0 using milkyway version 82
27-Jan-2012 11:44:14 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix0_3_2213973_0 exited
27-Jan-2012 11:44:14 [Milkyway@Home] Task ps_separation_82_2s_mix0_3_2213973_0 exited with zero status but no 'finished' file
27-Jan-2012 11:44:14 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:44:14 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix0_3_2213973_0 from handle_premature_exit
27-Jan-2012 11:44:14 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:44:14 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix0_3_2213973_0 from temporary exit
27-Jan-2012 11:44:14 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38316
27-Jan-2012 11:44:14 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix3_3_2494394_0 from start
27-Jan-2012 11:44:14 [Milkyway@Home] Starting task ps_separation_82_2s_mix3_3_2494394_0 using milkyway version 82
27-Jan-2012 11:44:15 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix1_2_5269588_0 exited
27-Jan-2012 11:44:15 [Milkyway@Home] Task ps_separation_82_2s_mix1_2_5269588_0 exited with zero status but no 'finished' file
27-Jan-2012 11:44:15 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:44:15 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix1_2_5269588_0 from handle_premature_exit
27-Jan-2012 11:44:15 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:44:15 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix1_2_5269588_0 from temporary exit
27-Jan-2012 11:44:15 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38323
27-Jan-2012 11:44:15 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix1_3_2491539_1 from start
27-Jan-2012 11:44:15 [Milkyway@Home] Starting task ps_separation_82_2s_mix1_3_2491539_1 using milkyway version 82
27-Jan-2012 11:44:16 [Milkyway@Home] [task] Process for ps_separation_82_2s_mix2_3_2212143_0 exited
27-Jan-2012 11:44:16 [Milkyway@Home] Task ps_separation_82_2s_mix2_3_2212143_0 exited with zero status but no 'finished' file
27-Jan-2012 11:44:16 [Milkyway@Home] If this happens repeatedly you may need to reset the project.
27-Jan-2012 11:44:16 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2212143_0 from handle_premature_exit
27-Jan-2012 11:44:16 [Milkyway@Home] [task] task called temporary_exit(600.000000)
27-Jan-2012 11:44:16 [Milkyway@Home] [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2212143_0 from temporary exit
27-Jan-2012 11:44:16 [Milkyway@Home] [task] ACTIVE_TASK::start(): forked process: pid 38330
27-Jan-2012 11:44:16 [Milkyway@Home] [task] task_state=EXECUTING for ps_separation_82_2s_mix1_3_2487122_1 from start
27-Jan-2012 11:44:16 [Milkyway@Home] Starting task ps_separation_82_2s_mix1_3_2487122_1 using milkyway version 82
27-Jan-2012 11:44:35 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482889_0 checkpointed
27-Jan-2012 11:45:10 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482888_0 checkpointed
27-Jan-2012 11:45:11 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482887_0 checkpointed
27-Jan-2012 11:45:14 [Milkyway@Home] [task] result ps_separation_82_2s_mix4_3_2494151_0 checkpointed
27-Jan-2012 11:45:14 [Milkyway@Home] [task] result ps_separation_82_2s_mix4_3_2494141_0 checkpointed
27-Jan-2012 11:45:16 [Milkyway@Home] [task] result ps_separation_82_2s_mix3_3_2494394_0 checkpointed
27-Jan-2012 11:45:17 [Milkyway@Home] [task] result ps_separation_82_2s_mix1_3_2491539_1 checkpointed
27-Jan-2012 11:45:18 [Milkyway@Home] [task] result ps_separation_82_2s_mix1_3_2487122_1 checkpointed
27-Jan-2012 11:45:35 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482889_0 checkpointed
27-Jan-2012 11:45:40 [Milkyway@Home] Sending scheduler request: To fetch work.
27-Jan-2012 11:45:40 [Milkyway@Home] Reporting 1 completed tasks, requesting new tasks for CPU
27-Jan-2012 11:45:41 [Milkyway@Home] Scheduler request completed: got 1 new tasks
27-Jan-2012 11:45:41 [Milkyway@Home] [task] result state=NEW for ps_separation_82_2s_mix1_3_2105654_1 from handle_scheduler_reply
27-Jan-2012 11:45:42 [Milkyway@Home] [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_3_2105654_1 from CS::update_results
27-Jan-2012 11:45:43 [Milkyway@Home] [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_3_2105654_1 from CS::update_results
27-Jan-2012 11:46:10 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482888_0 checkpointed
27-Jan-2012 11:46:11 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482887_0 checkpointed
27-Jan-2012 11:46:14 [Milkyway@Home] [task] result ps_separation_82_2s_mix4_3_2494151_0 checkpointed
27-Jan-2012 11:46:14 [Milkyway@Home] [task] result ps_separation_82_2s_mix4_3_2494141_0 checkpointed
27-Jan-2012 11:46:16 [Milkyway@Home] [task] result ps_separation_82_2s_mix3_3_2494394_0 checkpointed
27-Jan-2012 11:46:17 [Milkyway@Home] [task] result ps_separation_82_2s_mix1_3_2491539_1 checkpointed
27-Jan-2012 11:46:18 [Milkyway@Home] [task] result ps_separation_82_2s_mix1_3_2487122_1 checkpointed
27-Jan-2012 11:46:35 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482889_0 checkpointed
27-Jan-2012 11:46:46 [Milkyway@Home] Sending scheduler request: To fetch work.
27-Jan-2012 11:46:46 [Milkyway@Home] Requesting new tasks for CPU
27-Jan-2012 11:46:47 [Milkyway@Home] Scheduler request completed: got 0 new tasks
27-Jan-2012 11:46:47 [Milkyway@Home] No tasks sent
27-Jan-2012 11:46:47 [Milkyway@Home] This computer has reached a limit on tasks in progress
27-Jan-2012 11:47:10 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482888_0 checkpointed
27-Jan-2012 11:47:11 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482887_0 checkpointed
27-Jan-2012 11:47:14 [Milkyway@Home] [task] result ps_separation_82_2s_mix4_3_2494151_0 checkpointed
27-Jan-2012 11:47:14 [Milkyway@Home] [task] result ps_separation_82_2s_mix4_3_2494141_0 checkpointed
27-Jan-2012 11:47:16 [Milkyway@Home] [task] result ps_separation_82_2s_mix3_3_2494394_0 checkpointed
27-Jan-2012 11:47:17 [Milkyway@Home] [task] result ps_separation_82_2s_mix1_3_2491539_1 checkpointed
27-Jan-2012 11:47:18 [Milkyway@Home] [task] result ps_separation_82_2s_mix1_3_2487122_1 checkpointed
27-Jan-2012 11:47:36 [Milkyway@Home] [task] result ps_separation_82_2s_mix2_3_2482889_0 checkpointed
7) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42275)
Posted 27 Jan 2012 by Jimmy G (BA)
Post:
Hi Charlie,

Well, the (waiting for GPU memory) status is odd for showing up on my machine as I don't have a GPU for which any of my BOINC projects could call into action! The AMD Radeon HD 6970M should never be receiving any calls from any of the software involved. Am I missing something here?

Also, it would appear that I cannot
set the coproc_debug flag in your cc_config.xml file
as I'm still running 6.12.35. From your link...

<coproc_debug>
Show details of coprocessor (GPU) scheduling. List-add.png New in 6.3


As for...

My concerns are the several other issues you have raised, such as the md5 errors, spontaneous restarts, etc.


...I just suffered another CPU lockup issue so I decided to look into my system logs to see if any clues existed there. I'll be starting a new thread for that issue once I have my information gathered. For now, it looks like the BOINC Manager is going into an endless loop without an exit door built in...but more on that in the upcoming post.

As for testing, I have been giving it my consideration...I went so far as to subscribe to the Boinc Alpha Mailing List <boinc_alpha at ssl.berkeley dot edu> to get a better idea of the work involved...it looks interesting. I've got a busy Spring ahead of me, but things might be more forgiving time-wise some time over the summer... :)

Best,
JG
8) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42259)
Posted 26 Jan 2012 by Jimmy G (BA)
Post:
Hi Jimmy G,

The application that was restarting appears to be the BOINC Client, not the BOINC Manager (which is just the user interface to the Client). But since there was no crash report in stderrdae.txt, I don't have any idea why it restarted itself.

I have forwarded the information you sent me to David Anderson. He is the person who has been working on the BOINC scheduler. I really know very little about that aspect of BOINC. I am hoping he can help you figure this out.

Cheers,
--Charlie


Hi Charlie,

Thanks for getting back on this... :)

My hope here has been to lend you folks a hand on (what have turned out to be) some of the not-so-common (?) glitches with running BOINC projects...though my particular setup seems to encounter them with a fair bit of regularity...

The Waiting to run (waiting for GPU memory) status occurs several times a month on my end and, as mentioned in the OP, perpetrates itself in a couple of scenarios. It took me a while of paying attention (read: babysitting) to figure out the series of events leading up to the error event.

My other hope here has been to be able to facilitate whatever I can on my end to help you folks log, track down or otherwise gather some important clues as to the cause of these glitches. Fortunately (for you) I have been temporarily retired and have had some free time on my hands to play with this...though that situation will change on my end. Sooo, I figured, let's take a crack-at-it, while I still can, and maybe you folks can walk away with a better understanding of some of the anomalies that are occurring with your code.

Like I've mentioned several times...if there is any troubleshooting code or instructions or scripts that you folks need me to run on my end to better monitor the wayward processes kindly let me know where I can help! FWIW, I'm retired 32-year telecom tech...so I'm not completely without skills! Ha!

Best to you,
:)

P.S. I still have those 7 WUs sitting in both the queue and in memory and they will be due back by their February 5th deadline...so the clock is ticking on these if there's anything you'd like me to do with them to help you out!

...tick, tick, tick, tick, tick...
9) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42242)
Posted 25 Jan 2012 by Jimmy G (BA)
Post:
Not without sending along your complete BOINC Data directory. It isn't just copying the tasks along to another computer, it requires an attachment to that project, entries made in the client_state.xml file etc.


Tell me exactly what you need.../library/application support/boinc data? That weighs in at 10.71GB...to big for an email attachment. :) Perhaps I can send along the contents in a series of attachments?

:)

Edit: Looking at the contents of that folder the bulk of it is the CPDN folder @ 10.45GB...that's all been suspended by me for the past week waiting to hear back from you folks on tripping First Issue... above. That leaves a remainder of ~0.26GB...much more reasonable... :)
10) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42240)
Posted 25 Jan 2012 by Jimmy G (BA)
Post:
Hi Folks,

Just a thought here...

Seeing how these 7 flaky WUs are still sitting in memory on my end, is there a way to save them in their current state and send them along to be compared with fresh, unadulterated, unprocessed copies as found on the MWAH server? Perhaps there might be some clues in there that might shed light on what happened to them to behave this way?

FWIW, MWAH continues to send WUs to me and they are all being processed properly and being returned just fine...something happened along the way to cause these 7 to go, er, bad.

Like I said, they're still in memory on my end!

:)

The WUs involved are...

Task 81153514 = ps_separation_82_2s_mix2_3_2212143_0
http://milkyway.cs.rpi.edu/milkyway/result.php?resultid=81153514

Task 81154859 = ps_separation_82_2s_mix1_2_5269588_0
http://milkyway.cs.rpi.edu/milkyway/result.php?resultid=81154859

Task 81156265 = ps_separation_82_2s_mix0_3_2213973_0
http://milkyway.cs.rpi.edu/milkyway/result.php?resultid=81156265

Task 81157670 = ps_separation_82_2s_mix3_3_2213578_0
http://milkyway.cs.rpi.edu/milkyway/result.php?resultid=81157670

Task 81158385 = ps_separation_82_2s_mix4_3_2167426_2
http://milkyway.cs.rpi.edu/milkyway/result.php?resultid=81158385

Task 81204351 = ps_separation_82_2s_coadd_2_2216702_0
http://milkyway.cs.rpi.edu/milkyway/result.php?resultid=81204351

Task 81231096 = ps_separation_82_2s_mix2_3_2219069_1
http://milkyway.cs.rpi.edu/milkyway/result.php?resultid=81231096
11) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42238)
Posted 25 Jan 2012 by Jimmy G (BA)
Post:
Midday Update:
Okay, so much for tripping these WUs manually...MWAH ran out of WUs on its own accord and tripped the dreaded Waiting to run (waiting for GPU memory) errors on its own when it tried to put these errant WUs back to work!...

Task 81153514 = ps_separation_82_2s_mix2_3_2212143_0
Task 81154859 = ps_separation_82_2s_mix1_2_5269588_0
Task 81156265 = ps_separation_82_2s_mix0_3_2213973_0
Task 81157670 = ps_separation_82_2s_mix3_3_2213578_0
Task 81158385 = ps_separation_82_2s_mix4_3_2167426_2
Task 81204351 = ps_separation_82_2s_coadd_2_2216702_0
Task 81231096 = ps_separation_82_2s_mix2_3_2219069_1

They are all now sitting in my queue with Waiting to run (waiting for GPU memory) and will have to be manually cleared from memory to run properly.

Following the fate of WU ps_separation_82_2s_mix2_3_2212143_0 we come up with this series of events...

Waiting for GPU Train Wreck log.txt:16: Wed Jan 25 12:35:47 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2212143_0 from start
Waiting for GPU Train Wreck log.txt:17: Wed Jan 25 12:35:47 2012 | Milkyway@Home | Restarting task ps_separation_82_2s_mix2_3_2212143_0 using milkyway version 82
Waiting for GPU Train Wreck log.txt:90: Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix2_3_2212143_0 exited
Waiting for GPU Train Wreck log.txt:91: Wed Jan 25 12:36:22 2012 | Milkyway@Home | Task ps_separation_82_2s_mix2_3_2212143_0 exited with zero status but no 'finished' file
Waiting for GPU Train Wreck log.txt:93: Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2212143_0 from handle_premature_exit
Waiting for GPU Train Wreck log.txt:95: Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2212143_0 from temporary exit


Full gory details below...

Wed Jan 25 12:35:19 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix2_3_2257194_0 checkpointed
Wed Jan 25 12:35:19 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix2_3_2267326_0 checkpointed
Wed Jan 25 12:35:28 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix3_3_2268358_0 checkpointed
Wed Jan 25 12:35:28 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix3_3_2268355_0 checkpointed
Wed Jan 25 12:35:28 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix3_3_2268344_0 checkpointed
Wed Jan 25 12:35:28 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix3_3_2268332_0 checkpointed
Wed Jan 25 12:35:29 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix3_3_2268357_0 checkpointed
Wed Jan 25 12:35:29 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix3_3_2268353_0 checkpointed
Wed Jan 25 12:35:47 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix2_3_2267326_0 exited
Wed Jan 25 12:35:47 2012 | Milkyway@Home | [task] task_state=EXITED for ps_separation_82_2s_mix2_3_2267326_0 from handle_exited_app
Wed Jan 25 12:35:47 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:35:47 2012 | Milkyway@Home | Computation for task ps_separation_82_2s_mix2_3_2267326_0 finished
Wed Jan 25 12:35:47 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix2_3_2267326_0 from CS::app_finished
Wed Jan 25 12:35:47 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix2_3_2267326_0 from CS::update_results
Wed Jan 25 12:35:47 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17418
Wed Jan 25 12:35:47 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2212143_0 from start
Wed Jan 25 12:35:47 2012 | Milkyway@Home | Restarting task ps_separation_82_2s_mix2_3_2212143_0 using milkyway version 82
Wed Jan 25 12:35:49 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix2_3_2257194_0 exited
Wed Jan 25 12:35:49 2012 | Milkyway@Home | [task] task_state=EXITED for ps_separation_82_2s_mix2_3_2257194_0 from handle_exited_app
Wed Jan 25 12:35:49 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:35:49 2012 | Milkyway@Home | Computation for task ps_separation_82_2s_mix2_3_2257194_0 finished
Wed Jan 25 12:35:49 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix2_3_2257194_0 from CS::app_finished
Wed Jan 25 12:35:49 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix2_3_2257194_0 from CS::update_results
Wed Jan 25 12:35:49 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17421
Wed Jan 25 12:35:49 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix1_2_5269588_0 from start
Wed Jan 25 12:35:49 2012 | Milkyway@Home | Restarting task ps_separation_82_2s_mix1_2_5269588_0 using milkyway version 82
Wed Jan 25 12:35:51 2012 | Milkyway@Home | Sending scheduler request: To fetch work.
Wed Jan 25 12:35:51 2012 | Milkyway@Home | Reporting 2 completed tasks, requesting new tasks for CPU
Wed Jan 25 12:35:52 2012 | Milkyway@Home | Scheduler request completed: got 2 new tasks
Wed Jan 25 12:35:52 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7289759_0 from handle_scheduler_reply
Wed Jan 25 12:35:52 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7289769_0 from handle_scheduler_reply
Wed Jan 25 12:35:53 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7289769_0 from CS::update_results
Wed Jan 25 12:35:53 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7289759_0 from CS::update_results
Wed Jan 25 12:35:54 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7289769_0 from CS::update_results
Wed Jan 25 12:35:54 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7289759_0 from CS::update_results
Wed Jan 25 12:35:55 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix3_3_2268344_0 exited
Wed Jan 25 12:35:55 2012 | Milkyway@Home | [task] task_state=EXITED for ps_separation_82_2s_mix3_3_2268344_0 from handle_exited_app
Wed Jan 25 12:35:55 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:35:55 2012 | Milkyway@Home | Computation for task ps_separation_82_2s_mix3_3_2268344_0 finished
Wed Jan 25 12:35:55 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix3_3_2268344_0 from CS::app_finished
Wed Jan 25 12:35:55 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix3_3_2268344_0 from CS::update_results
Wed Jan 25 12:35:55 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17422
Wed Jan 25 12:35:55 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix0_3_2213973_0 from start
Wed Jan 25 12:35:55 2012 | Milkyway@Home | Restarting task ps_separation_82_2s_mix0_3_2213973_0 using milkyway version 82
Wed Jan 25 12:35:56 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix3_3_2268353_0 exited
Wed Jan 25 12:35:56 2012 | Milkyway@Home | [task] task_state=EXITED for ps_separation_82_2s_mix3_3_2268353_0 from handle_exited_app
Wed Jan 25 12:35:56 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:35:56 2012 | Milkyway@Home | Computation for task ps_separation_82_2s_mix3_3_2268353_0 finished
Wed Jan 25 12:35:56 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix3_3_2268353_0 from CS::app_finished
Wed Jan 25 12:35:56 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix3_3_2268353_0 from CS::update_results
Wed Jan 25 12:35:56 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17423
Wed Jan 25 12:35:56 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix3_3_2213578_0 from start
Wed Jan 25 12:35:56 2012 | Milkyway@Home | Restarting task ps_separation_82_2s_mix3_3_2213578_0 using milkyway version 82
Wed Jan 25 12:35:57 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix3_3_2268332_0 exited
Wed Jan 25 12:35:57 2012 | Milkyway@Home | [task] task_state=EXITED for ps_separation_82_2s_mix3_3_2268332_0 from handle_exited_app
Wed Jan 25 12:35:57 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:35:57 2012 | Milkyway@Home | Computation for task ps_separation_82_2s_mix3_3_2268332_0 finished
Wed Jan 25 12:35:57 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix3_3_2268332_0 from CS::app_finished
Wed Jan 25 12:35:57 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix3_3_2268332_0 from CS::update_results
Wed Jan 25 12:35:57 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17424
Wed Jan 25 12:35:57 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix4_3_2167426_2 from start
Wed Jan 25 12:35:57 2012 | Milkyway@Home | Restarting task ps_separation_82_2s_mix4_3_2167426_2 using milkyway version 82
Wed Jan 25 12:35:58 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix3_3_2268355_0 exited
Wed Jan 25 12:35:58 2012 | Milkyway@Home | [task] task_state=EXITED for ps_separation_82_2s_mix3_3_2268355_0 from handle_exited_app
Wed Jan 25 12:35:58 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:35:58 2012 | Milkyway@Home | Computation for task ps_separation_82_2s_mix3_3_2268355_0 finished
Wed Jan 25 12:35:58 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix3_3_2268355_0 from CS::app_finished
Wed Jan 25 12:35:58 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix3_3_2268355_0 from CS::update_results
Wed Jan 25 12:35:58 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17426
Wed Jan 25 12:35:58 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_coadd_2_2216702_0 from start
Wed Jan 25 12:35:58 2012 | Milkyway@Home | Restarting task ps_separation_82_2s_coadd_2_2216702_0 using milkyway version 82
Wed Jan 25 12:35:59 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix3_3_2268357_0 exited
Wed Jan 25 12:35:59 2012 | Milkyway@Home | [task] task_state=EXITED for ps_separation_82_2s_mix3_3_2268357_0 from handle_exited_app
Wed Jan 25 12:35:59 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:35:59 2012 | Milkyway@Home | Computation for task ps_separation_82_2s_mix3_3_2268357_0 finished
Wed Jan 25 12:35:59 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix3_3_2268357_0 from CS::app_finished
Wed Jan 25 12:35:59 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix3_3_2268357_0 from CS::update_results
Wed Jan 25 12:35:59 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17427
Wed Jan 25 12:35:59 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2219069_1 from start
Wed Jan 25 12:35:59 2012 | Milkyway@Home | Restarting task ps_separation_82_2s_mix2_3_2219069_1 using milkyway version 82
Wed Jan 25 12:36:00 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix3_3_2268358_0 exited
Wed Jan 25 12:36:00 2012 | Milkyway@Home | [task] task_state=EXITED for ps_separation_82_2s_mix3_3_2268358_0 from handle_exited_app
Wed Jan 25 12:36:00 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:36:00 2012 | Milkyway@Home | Computation for task ps_separation_82_2s_mix3_3_2268358_0 finished
Wed Jan 25 12:36:00 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for ps_separation_82_2s_mix3_3_2268358_0 from CS::app_finished
Wed Jan 25 12:36:00 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for ps_separation_82_2s_mix3_3_2268358_0 from CS::update_results
Wed Jan 25 12:36:00 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17432
Wed Jan 25 12:36:00 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix3_3_2268295_0 from start
Wed Jan 25 12:36:00 2012 | Milkyway@Home | Starting task ps_separation_82_2s_mix3_3_2268295_0 using milkyway version 82
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix2_3_2212143_0 exited
Wed Jan 25 12:36:22 2012 | Milkyway@Home | Task ps_separation_82_2s_mix2_3_2212143_0 exited with zero status but no 'finished' file
Wed Jan 25 12:36:22 2012 | Milkyway@Home | If this happens repeatedly you may need to reset the project.
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2212143_0 from handle_premature_exit
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task called temporary_exit(600.000000)
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2212143_0 from temporary exit
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=SUSPENDED for ps_separation_82_2s_mix1_2_5269588_0 from suspend
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=SUSPENDED for ps_separation_82_2s_mix0_3_2213973_0 from suspend
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=SUSPENDED for ps_separation_82_2s_mix3_3_2213578_0 from suspend
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=SUSPENDED for ps_separation_82_2s_mix4_3_2167426_2 from suspend
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=SUSPENDED for ps_separation_82_2s_coadd_2_2216702_0 from suspend
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=SUSPENDED for ps_separation_82_2s_mix2_3_2219069_1 from suspend
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=SUSPENDED for ps_separation_82_2s_mix3_3_2268295_0 from suspend
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17439
Wed Jan 25 12:36:22 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7275251_1 from start
Wed Jan 25 12:36:22 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7275251_1 using milkyway_nbody version 84
Wed Jan 25 12:36:24 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix1_2_5269588_0 exited
Wed Jan 25 12:36:24 2012 | Milkyway@Home | Task ps_separation_82_2s_mix1_2_5269588_0 exited with zero status but no 'finished' file
Wed Jan 25 12:36:24 2012 | Milkyway@Home | If this happens repeatedly you may need to reset the project.
Wed Jan 25 12:36:24 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix1_2_5269588_0 from handle_premature_exit
Wed Jan 25 12:36:24 2012 | Milkyway@Home | [task] task called temporary_exit(600.000000)
Wed Jan 25 12:36:24 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix1_2_5269588_0 from temporary exit
Wed Jan 25 12:36:28 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7275251_1 exited
Wed Jan 25 12:36:28 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7275251_1 from handle_exited_app
Wed Jan 25 12:36:28 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:36:28 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7275251_1 finished
Wed Jan 25 12:36:28 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7275251_1 from CS::app_finished
Wed Jan 25 12:36:28 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7275251_1 from CS::update_results
Wed Jan 25 12:36:28 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17445
Wed Jan 25 12:36:28 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7274863_1 from start
Wed Jan 25 12:36:28 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7274863_1 using milkyway_nbody version 84
Wed Jan 25 12:36:30 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix0_3_2213973_0 exited
Wed Jan 25 12:36:30 2012 | Milkyway@Home | Task ps_separation_82_2s_mix0_3_2213973_0 exited with zero status but no 'finished' file
Wed Jan 25 12:36:30 2012 | Milkyway@Home | If this happens repeatedly you may need to reset the project.
Wed Jan 25 12:36:30 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix0_3_2213973_0 from handle_premature_exit
Wed Jan 25 12:36:30 2012 | Milkyway@Home | [task] task called temporary_exit(600.000000)
Wed Jan 25 12:36:30 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix0_3_2213973_0 from temporary exit
Wed Jan 25 12:36:31 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix3_3_2213578_0 exited
Wed Jan 25 12:36:31 2012 | Milkyway@Home | Task ps_separation_82_2s_mix3_3_2213578_0 exited with zero status but no 'finished' file
Wed Jan 25 12:36:31 2012 | Milkyway@Home | If this happens repeatedly you may need to reset the project.
Wed Jan 25 12:36:31 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix3_3_2213578_0 from handle_premature_exit
Wed Jan 25 12:36:31 2012 | Milkyway@Home | [task] task called temporary_exit(600.000000)
Wed Jan 25 12:36:31 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix3_3_2213578_0 from temporary exit
Wed Jan 25 12:36:32 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix4_3_2167426_2 exited
Wed Jan 25 12:36:32 2012 | Milkyway@Home | Task ps_separation_82_2s_mix4_3_2167426_2 exited with zero status but no 'finished' file
Wed Jan 25 12:36:32 2012 | Milkyway@Home | If this happens repeatedly you may need to reset the project.
Wed Jan 25 12:36:32 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix4_3_2167426_2 from handle_premature_exit
Wed Jan 25 12:36:32 2012 | Milkyway@Home | [task] task called temporary_exit(600.000000)
Wed Jan 25 12:36:32 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix4_3_2167426_2 from temporary exit
Wed Jan 25 12:36:33 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_coadd_2_2216702_0 exited
Wed Jan 25 12:36:33 2012 | Milkyway@Home | Task ps_separation_82_2s_coadd_2_2216702_0 exited with zero status but no 'finished' file
Wed Jan 25 12:36:33 2012 | Milkyway@Home | If this happens repeatedly you may need to reset the project.
Wed Jan 25 12:36:33 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_coadd_2_2216702_0 from handle_premature_exit
Wed Jan 25 12:36:33 2012 | Milkyway@Home | [task] task called temporary_exit(600.000000)
Wed Jan 25 12:36:33 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_coadd_2_2216702_0 from temporary exit
Wed Jan 25 12:36:34 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7274863_1 exited
Wed Jan 25 12:36:34 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7274863_1 from handle_exited_app
Wed Jan 25 12:36:34 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:36:34 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7274863_1 finished
Wed Jan 25 12:36:34 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7274863_1 from CS::app_finished
Wed Jan 25 12:36:34 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7274863_1 from CS::update_results
Wed Jan 25 12:36:34 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17450
Wed Jan 25 12:36:34 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7272359_1 from start
Wed Jan 25 12:36:34 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7272359_1 using milkyway_nbody version 84
Wed Jan 25 12:36:35 2012 | Milkyway@Home | [task] Process for ps_separation_82_2s_mix2_3_2219069_1 exited
Wed Jan 25 12:36:35 2012 | Milkyway@Home | Task ps_separation_82_2s_mix2_3_2219069_1 exited with zero status but no 'finished' file
Wed Jan 25 12:36:35 2012 | Milkyway@Home | If this happens repeatedly you may need to reset the project.
Wed Jan 25 12:36:35 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2219069_1 from handle_premature_exit
Wed Jan 25 12:36:35 2012 | Milkyway@Home | [task] task called temporary_exit(600.000000)
Wed Jan 25 12:36:35 2012 | Milkyway@Home | [task] task_state=UNINITIALIZED for ps_separation_82_2s_mix2_3_2219069_1 from temporary exit
Wed Jan 25 12:36:40 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7272359_1 exited
Wed Jan 25 12:36:40 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7272359_1 from handle_exited_app
Wed Jan 25 12:36:40 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:36:40 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7272359_1 finished
Wed Jan 25 12:36:40 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7272359_1 from CS::app_finished
Wed Jan 25 12:36:40 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7272359_1 from CS::update_results
Wed Jan 25 12:36:40 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17456
Wed Jan 25 12:36:40 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7272323_1 from start
Wed Jan 25 12:36:40 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7272323_1 using milkyway_nbody version 84
Wed Jan 25 12:36:46 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7272323_1 exited
Wed Jan 25 12:36:46 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7272323_1 from handle_exited_app
Wed Jan 25 12:36:46 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:36:46 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7272323_1 finished
Wed Jan 25 12:36:46 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7272323_1 from CS::app_finished
Wed Jan 25 12:36:46 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7272323_1 from CS::update_results
Wed Jan 25 12:36:46 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17461
Wed Jan 25 12:36:46 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7269146_1 from start
Wed Jan 25 12:36:46 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7269146_1 using milkyway_nbody version 84
Wed Jan 25 12:36:52 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7269146_1 exited
Wed Jan 25 12:36:52 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7269146_1 from handle_exited_app
Wed Jan 25 12:36:52 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:36:52 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7269146_1 finished
Wed Jan 25 12:36:52 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7269146_1 from CS::app_finished
Wed Jan 25 12:36:52 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7269146_1 from CS::update_results
Wed Jan 25 12:36:52 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17467
Wed Jan 25 12:36:52 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7264177_1 from start
Wed Jan 25 12:36:52 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7264177_1 using milkyway_nbody version 84
Wed Jan 25 12:36:57 2012 | Milkyway@Home | Sending scheduler request: To fetch work.
Wed Jan 25 12:36:57 2012 | Milkyway@Home | Reporting 11 completed tasks, requesting new tasks for CPU
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7264177_1 exited
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7264177_1 from handle_exited_app
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:36:58 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7264177_1 finished
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7264177_1 from CS::app_finished
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7264177_1 from CS::update_results
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17473
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7255463_1 from start
Wed Jan 25 12:36:58 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7255463_1 using milkyway_nbody version 84
Wed Jan 25 12:36:58 2012 | Milkyway@Home | Scheduler request completed: got 11 new tasks
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7289889_0 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_mix0_3_2099910_1 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7289892_0 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_coadd_2_986425_1 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7225211_1 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_mix1_2_5335037_1 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7289900_0 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_coadd_2_2184664_1 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_5660309_2 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_mix2_3_2217589_1 from handle_scheduler_reply
Wed Jan 25 12:36:58 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7289885_0 from handle_scheduler_reply
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix2_3_2217589_1 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_2_5335037_1 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix0_3_2099910_1 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_coadd_2_986425_1 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_coadd_2_2184664_1 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7289900_0 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7289892_0 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7289889_0 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7289885_0 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7225211_1 from CS::update_results
Wed Jan 25 12:36:59 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_5660309_2 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix2_3_2217589_1 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_2_5335037_1 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix0_3_2099910_1 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_coadd_2_986425_1 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_coadd_2_2184664_1 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7289900_0 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7289892_0 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7289889_0 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7289885_0 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7225211_1 from CS::update_results
Wed Jan 25 12:37:00 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_5660309_2 from CS::update_results
Wed Jan 25 12:37:04 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7255463_1 exited
Wed Jan 25 12:37:04 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7255463_1 from handle_exited_app
Wed Jan 25 12:37:04 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:04 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7255463_1 finished
Wed Jan 25 12:37:04 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7255463_1 from CS::app_finished
Wed Jan 25 12:37:04 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7255463_1 from CS::update_results
Wed Jan 25 12:37:04 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17478
Wed Jan 25 12:37:04 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_5652511_2 from start
Wed Jan 25 12:37:04 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_5652511_2 using milkyway_nbody version 84
Wed Jan 25 12:37:10 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_5652511_2 exited
Wed Jan 25 12:37:10 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_5652511_2 from handle_exited_app
Wed Jan 25 12:37:10 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:10 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_5652511_2 finished
Wed Jan 25 12:37:10 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_5652511_2 from CS::app_finished
Wed Jan 25 12:37:10 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_5652511_2 from CS::update_results
Wed Jan 25 12:37:10 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17484
Wed Jan 25 12:37:10 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7289769_0 from start
Wed Jan 25 12:37:10 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7289769_0 using milkyway_nbody version 84
Wed Jan 25 12:37:16 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7289769_0 exited
Wed Jan 25 12:37:16 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7289769_0 from handle_exited_app
Wed Jan 25 12:37:16 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:16 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7289769_0 finished
Wed Jan 25 12:37:16 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7289769_0 from CS::app_finished
Wed Jan 25 12:37:16 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7289769_0 from CS::update_results
Wed Jan 25 12:37:16 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17489
Wed Jan 25 12:37:16 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7289759_0 from start
Wed Jan 25 12:37:16 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7289759_0 using milkyway_nbody version 84
Wed Jan 25 12:37:22 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7289759_0 exited
Wed Jan 25 12:37:22 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7289759_0 from handle_exited_app
Wed Jan 25 12:37:22 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:22 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7289759_0 finished
Wed Jan 25 12:37:22 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7289759_0 from CS::app_finished
Wed Jan 25 12:37:22 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7289759_0 from CS::update_results
Wed Jan 25 12:37:22 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17495
Wed Jan 25 12:37:22 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7289900_0 from start
Wed Jan 25 12:37:22 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7289900_0 using milkyway_nbody version 84
Wed Jan 25 12:37:28 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7289900_0 exited
Wed Jan 25 12:37:28 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7289900_0 from handle_exited_app
Wed Jan 25 12:37:28 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:28 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7289900_0 finished
Wed Jan 25 12:37:28 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7289900_0 from CS::app_finished
Wed Jan 25 12:37:28 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7289900_0 from CS::update_results
Wed Jan 25 12:37:28 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17501
Wed Jan 25 12:37:28 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7289892_0 from start
Wed Jan 25 12:37:28 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7289892_0 using milkyway_nbody version 84
Wed Jan 25 12:37:34 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7289892_0 exited
Wed Jan 25 12:37:34 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7289892_0 from handle_exited_app
Wed Jan 25 12:37:34 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:34 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7289892_0 finished
Wed Jan 25 12:37:34 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7289892_0 from CS::app_finished
Wed Jan 25 12:37:34 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7289892_0 from CS::update_results
Wed Jan 25 12:37:34 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17506
Wed Jan 25 12:37:34 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7289889_0 from start
Wed Jan 25 12:37:34 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7289889_0 using milkyway_nbody version 84
Wed Jan 25 12:37:40 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7289889_0 exited
Wed Jan 25 12:37:40 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7289889_0 from handle_exited_app
Wed Jan 25 12:37:40 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:40 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7289889_0 finished
Wed Jan 25 12:37:40 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7289889_0 from CS::app_finished
Wed Jan 25 12:37:40 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7289889_0 from CS::update_results
Wed Jan 25 12:37:40 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17512
Wed Jan 25 12:37:40 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7289885_0 from start
Wed Jan 25 12:37:40 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7289885_0 using milkyway_nbody version 84
Wed Jan 25 12:37:46 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7289885_0 exited
Wed Jan 25 12:37:46 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7289885_0 from handle_exited_app
Wed Jan 25 12:37:46 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:46 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7289885_0 finished
Wed Jan 25 12:37:46 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7289885_0 from CS::app_finished
Wed Jan 25 12:37:46 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7289885_0 from CS::update_results
Wed Jan 25 12:37:46 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17517
Wed Jan 25 12:37:46 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_7225211_1 from start
Wed Jan 25 12:37:46 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_7225211_1 using milkyway_nbody version 84
Wed Jan 25 12:37:52 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_7225211_1 exited
Wed Jan 25 12:37:52 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_7225211_1 from handle_exited_app
Wed Jan 25 12:37:52 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:52 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_7225211_1 finished
Wed Jan 25 12:37:52 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_7225211_1 from CS::app_finished
Wed Jan 25 12:37:52 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_7225211_1 from CS::update_results
Wed Jan 25 12:37:52 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17523
Wed Jan 25 12:37:52 2012 | Milkyway@Home | [task] task_state=EXECUTING for nbody-Plum_Embedded_5660309_2 from start
Wed Jan 25 12:37:52 2012 | Milkyway@Home | Starting task nbody-Plum_Embedded_5660309_2 using milkyway_nbody version 84
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] Process for nbody-Plum_Embedded_5660309_2 exited
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] task_state=EXITED for nbody-Plum_Embedded_5660309_2 from handle_exited_app
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] process exited with status 0
Wed Jan 25 12:37:58 2012 | Milkyway@Home | Computation for task nbody-Plum_Embedded_5660309_2 finished
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_5660309_2 from CS::app_finished
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_5660309_2 from CS::update_results
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix3_3_2268295_0 from unsuspend
Wed Jan 25 12:37:58 2012 | Milkyway@Home | Resuming task ps_separation_82_2s_mix3_3_2268295_0 using milkyway version 82
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17529
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix2_3_2217589_1 from start
Wed Jan 25 12:37:58 2012 | Milkyway@Home | Starting task ps_separation_82_2s_mix2_3_2217589_1 using milkyway version 82
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17534
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix1_2_5335037_1 from start
Wed Jan 25 12:37:58 2012 | Milkyway@Home | Starting task ps_separation_82_2s_mix1_2_5335037_1 using milkyway version 82
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17539
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix0_3_2099910_1 from start
Wed Jan 25 12:37:58 2012 | Milkyway@Home | Starting task ps_separation_82_2s_mix0_3_2099910_1 using milkyway version 82
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17544
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_coadd_2_986425_1 from start
Wed Jan 25 12:37:58 2012 | Milkyway@Home | Starting task ps_separation_82_2s_coadd_2_986425_1 using milkyway version 82
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17549
Wed Jan 25 12:37:58 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_coadd_2_2184664_1 from start
Wed Jan 25 12:37:58 2012 | Milkyway@Home | Starting task ps_separation_82_2s_coadd_2_2184664_1 using milkyway version 82
Wed Jan 25 12:37:59 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix3_3_2268295_0 checkpointed
Wed Jan 25 12:38:03 2012 | Milkyway@Home | Sending scheduler request: To fetch work.
Wed Jan 25 12:38:03 2012 | Milkyway@Home | Reporting 11 completed tasks, requesting new tasks for CPU
Wed Jan 25 12:38:04 2012 | Milkyway@Home | Scheduler request completed: got 11 new tasks
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7290007_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_mix1_3_2279491_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7289989_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_mix1_3_2279492_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7290013_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_mix1_3_2279493_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7290025_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_mix1_3_2279494_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7290026_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for ps_separation_82_2s_mix1_3_2279495_0 from handle_scheduler_reply
Wed Jan 25 12:38:04 2012 | Milkyway@Home | [task] result state=NEW for nbody-Plum_Embedded_7290027_0 from handle_scheduler_reply
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_3_2279495_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_3_2279494_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_3_2279493_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_3_2279492_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for ps_separation_82_2s_mix1_3_2279491_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7290027_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7290026_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7290025_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7290013_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7290007_0 from CS::update_results
Wed Jan 25 12:38:05 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADING for nbody-Plum_Embedded_7289989_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_3_2279495_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_3_2279494_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_3_2279493_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_3_2279492_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for ps_separation_82_2s_mix1_3_2279491_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7290027_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7290026_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7290025_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7290013_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7290007_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] result state=FILES_DOWNLOADED for nbody-Plum_Embedded_7289989_0 from CS::update_results
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17556
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix1_3_2279495_0 from start
Wed Jan 25 12:38:06 2012 | Milkyway@Home | Starting task ps_separation_82_2s_mix1_3_2279495_0 using milkyway version 82
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] ACTIVE_TASK::start(): forked process: pid 17561
Wed Jan 25 12:38:06 2012 | Milkyway@Home | [task] task_state=EXECUTING for ps_separation_82_2s_mix1_3_2279494_0 from start
Wed Jan 25 12:38:06 2012 | Milkyway@Home | Starting task ps_separation_82_2s_mix1_3_2279494_0 using milkyway version 82
Wed Jan 25 12:38:59 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix3_3_2268295_0 checkpointed
Wed Jan 25 12:38:59 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix2_3_2217589_1 checkpointed
Wed Jan 25 12:38:59 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix1_2_5335037_1 checkpointed
Wed Jan 25 12:38:59 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix0_3_2099910_1 checkpointed
Wed Jan 25 12:38:59 2012 | Milkyway@Home | [task] result ps_separation_82_2s_coadd_2_986425_1 checkpointed
Wed Jan 25 12:38:59 2012 | Milkyway@Home | [task] result ps_separation_82_2s_coadd_2_2184664_1 checkpointed
Wed Jan 25 12:39:08 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix1_3_2279495_0 checkpointed
Wed Jan 25 12:39:08 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix1_3_2279494_0 checkpointed
Wed Jan 25 12:39:09 2012 | Milkyway@Home | Sending scheduler request: To fetch work.
Wed Jan 25 12:39:09 2012 | Milkyway@Home | Requesting new tasks for CPU
Wed Jan 25 12:39:11 2012 | Milkyway@Home | Scheduler request completed: got 0 new tasks
Wed Jan 25 12:39:11 2012 | Milkyway@Home | No tasks sent
Wed Jan 25 12:39:11 2012 | Milkyway@Home | This computer has reached a limit on tasks in progress
Wed Jan 25 12:40:00 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix3_3_2268295_0 checkpointed
Wed Jan 25 12:40:00 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix2_3_2217589_1 checkpointed
Wed Jan 25 12:40:00 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix1_2_5335037_1 checkpointed
Wed Jan 25 12:40:00 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix0_3_2099910_1 checkpointed
Wed Jan 25 12:40:00 2012 | Milkyway@Home | [task] result ps_separation_82_2s_coadd_2_986425_1 checkpointed
Wed Jan 25 12:40:00 2012 | Milkyway@Home | [task] result ps_separation_82_2s_coadd_2_2184664_1 checkpointed
Wed Jan 25 12:40:08 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix1_3_2279495_0 checkpointed
Wed Jan 25 12:40:08 2012 | Milkyway@Home | [task] result ps_separation_82_2s_mix1_3_2279494_0 checkpointed
12) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42235)
Posted 25 Jan 2012 by Jimmy G (BA)
Post:
If he's around today, and you can get in contact with him, I've got some free time on my hands today and would be happy work with him over the phone if that would make life easier (than constantly checking emails and posts!). Let me know, I'll be happy to send send him my number.

:)
13) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42232)
Posted 25 Jan 2012 by Jimmy G (BA)
Post:
LOL

You got mice in there, ey? :-)


...yeah...you can leave 'em some of the sandwich if you like, the milk's on me... :)

I sent both Charlie and Dagorath a PM on this...are you interested in these files, too? I'll be happy to send them along (I've still got your email). Like I mentioned, I can crash this anytime you folks are ready, I'm just asking for some advanced warning on what files, info, etc. you'll need me to track down along with any dev code or such you'd like me to run that will help flush out whatever details you folks need.

:)
14) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42229)
Posted 25 Jan 2012 by Jimmy G (BA)
Post:
let me know what I can do for you folks before I pull the pin!

Tell us how to get to your bank-account. ;-)


Bring a flashlight and a magnifying glass when you go...and a small brown paper bag...just big enough for a peanut butter sandwich, no bigger...and, actually, that'll be too big, so bring the sandwich along also... :)
15) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42227)
Posted 25 Jan 2012 by Jimmy G (BA)
Post:
No problem. I think Charlie said he wants the stdoutdae.txt not stderr.txt.


Thanks Dagorath...I've waited to get a train wreck all lined up (See: Second Issue... above, the dreaded unattended spontaneous BOINC Manager restart variant of Waiting to run (waiting for GPU)! Woo hoo!) and have sent Charlie the associated files along with some notes and screen shots as to what is transpiring...

I'm "ready, willing and able" to crash your software for you...let me know what I can do for you folks before I pull the pin!

:)
16) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42127)
Posted 17 Jan 2012 by Jimmy G (BA)
Post:
...but no...

stderr.txt

...perhaps this file needs to be manually created and placed in this folder like the cc_config.xml had to be...?


No. The stderr.txt file is created by the project's science app in whatever slots directory the task has been assigned to. When the task finishes, the stderr.txt file is uploaded to the project server and kept as part of the task details on the project website. To view the task details and stderr.txt, go to the project website, click Your Account -> View Computers on this account. Locate the computer in question from the list of your computers, in the left-hand column click Tasks to see the list of tasks recently issued to that computer. In the left-hand column click "show names". Now from the Event Log you quoted earlier the task for which Charlie wants to see the stderr.txt is named "nbody-Plum_Embedded_5557114_1". Locate that name in the left-hand column and click it to see the details and the stderr.txt for that task. The text below the Stderr Output title is the stderr.txt plus a few extra lines.

Task details are not kept forever if you can't find nbody-Plum_Embedded_5557114_1 in the list it may already be deleted from the list. Or it may be on the next page so look for the "Next 20" link to get to the next page of the list.


Hi Dagorath,

Oofah, I just noticed this post from you (I've been skipping to the page bottom everytime I check this post and missed this one in the process!). My apologies!

Unfortunately, at this point, the WUs have since vanished from my online MWAH completed tasks list...however, I have been keeping my CPDN WUs on hold waiting for further instructions on how to log this series of events, so I'm just going to go ahead and let one reach its end-of-run to try and trip this glitch again. I will be sure to note all of the MWAH and CPDN WUs involved and then gather all the online stderr.txt reports to go along with the relevant stdoutdae.txt timeline log files.

FWIW, NBody 5557114 was just one of 7 MWAH WUs affected by this...keeping track of 7WUs in the timeline will be a task of sorts, I'll see what I can do to make the sequence of events seem coherent.

I still have the stdoutdae.txt from that day saved as a separate text document (not active, that is)...if anyone would like to look through it, it clearly shows what was happening to each WU for both CPDN and MWAH...I'll be happy to send it along! Perhaps it will yield some clues as to what to watch out for for the next occurrence?!

:)
17) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42110)
Posted 16 Jan 2012 by Jimmy G (BA)
Post:
Hi Charlie,

I also asked about the possibility of running some extra debugging/verbose error-logging code on my end...is there something in that arena I can do for you folks? I do have a queue of CPDN WUs nearing end-of-run that I can put to use to trigger this bug.

:)
18) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42109)
Posted 16 Jan 2012 by Jimmy G (BA)
Post:


Sorry. I meant to ask you for the stderrdae.txt file.

Cheers,
--Charlie


Hi Charlie,

As you'll note (below) the contents of the stderrdae.txt contain no entries-by-date/time, unlike the stdoutdae.txt from which I offered a snippet in my original post. As mentioned, that you would like that file (stdoutdae.txt) sent along with key events noted for the time line, it's yours for the asking!

:)

Entire content of stderrdae.txt file, as requested...

getaddrinfo: No such file or directory
getaddrinfo: No such file or directory
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_separation_0.82_x86_64-apple-darwin
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
getaddrinfo: Bad file descriptor
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
getaddrinfo: Bad file descriptor
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
getaddrinfo: Bad file descriptor
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
getaddrinfo: Bad file descriptor
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
md5_file: can't open projects/milkyway.cs.rpi.edu_milkyway/milkyway_nbody_0.84_x86_64-apple-darwin__mt
md5_file: Too many open files
error: verify_file: md5_file error -108
19) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42104)
Posted 16 Jan 2012 by Jimmy G (BA)
Post:
Like I said, I'll be happy to send along the important files on this and run a more thorough debugging routine for you folks (if there is one and someone can supply me with code and instructions!

Thanks for the report. Regarding issue 2, it looks like the BOINC Client crashed (not the BOINC Manager). The Manager automatically restarts the Client if this happens. Of particular interest would be an excerpt from the stderr.txt file from several minutes before the errors until the time of the restart (about 12:20 through 12:22 on 14-Jan-2012.) With luck, it might contain a crash log.

You can copy and paste these into either a response on this thread or a private message to me.

Also, it might be helpful to know which version of Mac OS X you are running.

Thanks in advance.

Cheers,
--Charlie


Hi Charlie,

Thanks for the response and interest...hopefully we can make some headway with this...

Okay, looking in */Library/Apllication Support/BOINC Data I'm seeing...

stderrdae.txt
sttderrgfx.txt
stderrgui.txt
stdoutdae.old
stdoutdae.txt
stdoutgui.txt


...but no...

stderr.txt

...perhaps this file needs to be manually created and placed in this folder like the cc_config.xml had to be...?

(On a side note I did look inside the 3 "err" files just to see what was inside them...I got a surprise and a good chuckle with the content of stderrgui.txt...

SIGPIPE: write on a pipe with no reader
kill: kill: kill: kill: 6107875164kill: kill: kill: : 7937975125: 5916585982No such process
: : : No such process
No such process
: 77498No such process
No such process
: No such process
No such process
SIGBUS: bus error

Crashed executable name: BOINCManager
built using BOINC library version 6.12.35
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Wed Oct 26 07:27:42 2011


...etc.. Ha! What's that all about?!)

:)
20) Message boards : Questions and problems : (Waiting on GPU) Returns!...Repeatable on demand! (Message 42081)
Posted 14 Jan 2012 by Jimmy G (BA)
Post:
Waiting to run (waiting for GPU memory) Redux
Now repeatable on demand! Error report available!

Back Story

Here we go... as a rule I generally run MWAH and CPDN on the same computer but at different times...I do this because they don't seem to play well together. CPDN runs overnight when my internet connection is shut down and MWAH I run during the day because it needs to constantly call the mother ship to keep itself busy with work. As a rule I generally allow either MWAH and CPDN WUs to finish their respective runs during their respective hours.

However, lately CPDN has been sending me the shorter hadam3p_eu WUs so I decided that if a particular WU could finish up in a few hours I would just let it finish its run after I did the A.M. switch-over to MWAH...so, 1 CPDN WU running and 7 MWAH WUs running...


First Issue...

Now, when the CPDN WU completes it should cause another another MWAH WU to begin from the queue, however that is not what is happening...instead, the 7 running MWAH WUs go into Waiting to run status and 8 fresh MWAH WUs are initiated from the queue. What happens next is that the 7 waiting to run WUs never begin processing...ever...they just sit in limbo status indefinitely.

There are two ways these WUs can come out of waiting status...

1. if the MWAH server runs out of WUs to send my machine, this queue of in-limbo WUs is called upon, or...

2. if I manually suspend the "Running" and "Ready to start" MWAH WUs in the queue to force the MWAH software to try an resume processing the in-limbo WUs.

And, then voila! After approximately 30-seconds of running the in-limbo WUs all return, one-by-one, a Waiting to run (waiting for GPU) status!


Second Issue...

Where this really gets interesting is that this whole cascade of events also causes the mysterious unattended spontaneous BOINC Manager restart phenomenon, as well! The log shows that about 25-minutes after the completed CPDN WU to MWAH WU transfer occurred some internal software bickering occurred and BOINC Manager just gave up and restarted itself...


14-Jan-2012 12:20:32 [Milkyway@Home] Computation for task nbody-Plum_Embedded_5557114_1 finished
14-Jan-2012 12:20:32 [Milkyway@Home] [task] result state=FILES_UPLOADING for nbody-Plum_Embedded_5557114_1 from CS::app_finished
14-Jan-2012 12:20:32 [Milkyway@Home] [task] result state=FILES_UPLOADED for nbody-Plum_Embedded_5557114_1 from CS::update_results
14-Jan-2012 12:20:32 [Milkyway@Home] Failed to open init file slots/7/init_data.xml
14-Jan-2012 12:20:32 [Milkyway@Home] Signature verification error for milkyway_nbody_0.84_x86_64-apple-darwin__mt
14-Jan-2012 12:20:32 [Milkyway@Home] [task] result state=COMPUTE_ERROR for nbody-Plum_Embedded_4665316_1 from CS::report_result_error
14-Jan-2012 12:20:32 [Milkyway@Home] [task] couldn't start app: Can't write init file: -108
14-Jan-2012 12:20:32 [Milkyway@Home] [task] task_state=COULDNT_START for nbody-Plum_Embedded_4665316_1 from start
14-Jan-2012 12:20:32 [Milkyway@Home] [task] task_state=COULDNT_START for nbody-Plum_Embedded_4665316_1 from resume_or_start1
14-Jan-2012 12:20:32 [---] Can't open client_state_next.xml: fopen() failed
14-Jan-2012 12:20:32 [---] Couldn't write state file: fopen() failed; giving up
14-Jan-2012 12:21:37 [---] Starting BOINC client version 6.12.35 for x86_64-apple-darwin
14-Jan-2012 12:21:37 [---] log flags: file_xfer, sched_ops, task, task_debug
14-Jan-2012 12:21:37 [---] Libraries: libcurl/7.19.7 OpenSSL/0.9.7l zlib/1.2.3 c-ares/1.6.0
14-Jan-2012 12:21:37 [---] Data directory: /Library/Application Support/BOINC Data
14-Jan-2012 12:21:37 [---] Processor: 8 GenuineIntel Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz [x86 Family 6 Model 42 Stepping 7]



That there is anyone interested looking into this further, I have saved the stdoutdae.txt file that clearly shows the sequence of events that are occurring...I'll be happy to email this with important event times marked for easy inspection.

I now believe I can repeat this on demand...just allow another CPDN WU to finish during a run of restarted MWAH WUs and...Boom. I will perform this sequence of events again to confirm repeatability.


How Can I Help?...

I would be happy to run any debugging/error-logging code someone could supply me. I am currently running the code that Ageless supplied me...

Jimmy, the developers ask you to run with a debug option on.
To do so, use any clear text editor to make a file called cc_config.xml in your BOINC Data directory (default in OS X at /Library/Applications Support/BOINC/

In it add the following lines:
<cc_config>
<log_flags>
<task_debug>1</task_debug>
</log_flags>
</cc_config>




...I'd be happy to help solve this error!

But we're not out of the woods just yet...


Third Issue...(the kick in the pants)...

Finally, to get the errant WUs to once again process and finish their tasks requires more than a simple "Shut down connected client..." command and BOINC Manager shutdown and restart. For whatever reason the errant WUs are not purged from memory though all other projects and WUs are! So a restart of BOINC Manager merely gets one back to the same situation...7 in-limbo MWAH WUs with Waiting to run (waiting for GPU) error statuses.

Bwahahahah! (Oops, sorry.) :)

To clear the problem one must then open OSX Activity Monitor and quit the stuck in-limbo WU processes manually one-by-one...each quit execution requiring user password entry to give Activity Monitor permission to execute.

Then BOINC Manager can be restarted and the once-errant MWAH WUs resume normal processing until completion.

End of Issues

Like I said, I'll be happy to send along the important files on this and run a more thorough debugging routine for you folks (if there is one and someone can supply me with code and instructions!)

That's all for now!

Phewww!

:)


Next 20

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.