BOINC Data on USB HDD

Message boards : Questions and problems : BOINC Data on USB HDD
Message board moderation

To post messages, you must log in.

AuthorMessage
PhilTheNet

Send message
Joined: 30 Dec 14
Posts: 13
France
Message 81302 - Posted: 16 Sep 2017, 7:53:22 UTC

Hello,
On my MacMini
(OS: Mac OS X 10.12.6 (Darwin 16.7.0)
Memory: 16.00 GB physical, 59.90 GB virtual
Disk: 232.57 GB total, 59.90 GB free
BOINC 7.8.2
VirtualBox version: 5.1.14r112924)

I moved the rep "BOINC Data"to a USB hdd
&
sudo ln -fhsv "/Volumes/SAUVEGARDE/BOINC Data" "/Library/Application Support/BOINC Data"
&
Mac_SA_Secure.sh to adjust the rights and restarted BOINC

All Projects works without pb but projects VB (LHC or another) ends in error after few minutes (While these same projects worked well with the old BOINC Data):

process exited with code 74 (0x4a, -182)
2017-09-11 13:53:18 (6388): Enabling shared directory for VM.
2017-09-11 13:53:18 (6388): Starting VM. (boinc_1b1dfc7fb8d9ea64, slot#2)
2017-09-11 13:54:04 (6388): VM failed to start.
2017-09-11 13:54:04 (6388): Powering off VM.
2017-09-11 13:54:04 (6388): Deregistering VM. (boinc_1b1dfc7fb8d9ea64, slot#2)
2017-09-11 13:54:04 (6388): Removing network bandwidth throttle group from VM.
2017-09-11 13:54:04 (6388): Removing storage controller(s) from VM.
2017-09-11 13:54:35 (6388): Removing VM from VirtualBox.
2017-09-11 13:55:07 (6388): Removing virtual disk drive from VirtualBox.
&
LHC@home] Computation for task IW3MDmVbYBrnDDn7oo6G73TpABFKDmABFKDmYIKKDmABFKDmAFGUUo_0 finished
[LHC@home] Output file IW3MDmVbYBrnDDn7oo6G73TpABFKDmABFKDmYIKKDmABFKDmAFGUUo_0_ATLAS_result for task IW3MDmVbYBrnDDn7oo6G73TpABFKDmABFKDmYIKKDmABFKDmAFGUUo_0 absent =>
mv: rename slots/2/shared/result.tar.gz to projects/lhcathome.cern.ch_lhcathome/IW3MDmVbYBrnDDn7oo6G73TpABFKDmABFKDmYIKKDmABFKDmAFGUUo_0_ATLAS_result: No such file or directory

It seems to me that the output file is not created in the slot

An idea ?

Thks
ID: 81302 · Report as offensive     Reply Quote
Profile Ageless
Volunteer moderator
Project administrator
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 12233
Netherlands
Message 81303 - Posted: 16 Sep 2017, 8:15:28 UTC - in response to Message 81302.  

This old post states you have to use Disk Utility to verify that Owners Enabled is set to yes on the new drive.You may also have to reinstall VirtualBox.
Jord
Please do not private message me for tech support. Use the forums for that. Tech PMs will be ignored.
ID: 81303 · Report as offensive     Reply Quote
Profile Ageless
Volunteer moderator
Project administrator
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 12233
Netherlands
Message 81304 - Posted: 16 Sep 2017, 8:22:38 UTC - in response to Message 81303.  

Having looked into that process exited with error 74 (and thanks for that, added to my FAQs. :-)) this does seem to be a VirtualBox permission or existence error.
Jord
Please do not private message me for tech support. Use the forums for that. Tech PMs will be ignored.
ID: 81304 · Report as offensive     Reply Quote
PhilTheNet

Send message
Joined: 30 Dec 14
Posts: 13
France
Message 81305 - Posted: 16 Sep 2017, 8:47:20 UTC - in response to Message 81303.  

Owners Enabled is set to yes => yes

&

reinstall VirtualBox => already done

Thsk
ID: 81305 · Report as offensive     Reply Quote
PhilTheNet

Send message
Joined: 30 Dec 14
Posts: 13
France
Message 81306 - Posted: 16 Sep 2017, 8:49:51 UTC - in response to Message 81304.  

the error seems to occur when the application wants to write (create) the results file


Thks
ID: 81306 · Report as offensive     Reply Quote
Profile Ageless
Volunteer moderator
Project administrator
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 12233
Netherlands
Message 81307 - Posted: 16 Sep 2017, 9:23:57 UTC - in response to Message 81306.  

Can you enable the slot_debug flag, please? BOINC Manager->Options_>Event Log options, and then post an output with that?
Jord
Please do not private message me for tech support. Use the forums for that. Tech PMs will be ignored.
ID: 81307 · Report as offensive     Reply Quote
PhilTheNet

Send message
Joined: 30 Dec 14
Posts: 13
France
Message 81308 - Posted: 16 Sep 2017, 10:17:00 UTC - in response to Message 81307.  
Last modified: 16 Sep 2017, 10:44:56 UTC

Sam 16 sep 12:07:46 2017 | LHC@home | Sending scheduler request: To fetch work.
Sam 16 sep 12:07:46 2017 | LHC@home | Requesting new tasks for CPU
Sam 16 sep 12:07:48 2017 | LHC@home | Scheduler request completed: got 1 new tasks
Sam 16 sep 12:07:50 2017 | LHC@home | Started download of jf_2fa1af40f9d9a1646e8156913db3dc9b
Sam 16 sep 12:07:50 2017 | LHC@home | Started download of x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm_input.tar.gz
Sam 16 sep 12:07:54 2017 | LHC@home | Finished download of x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm_input.tar.gz
Sam 16 sep 12:07:54 2017 | LHC@home | Started download of rte_x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm.tar.gz
Sam 16 sep 12:07:55 2017 | LHC@home | Finished download of rte_x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm.tar.gz
Sam 16 sep 12:07:55 2017 | LHC@home | Started download of boinc_job_script.exK6Yg
Sam 16 sep 12:07:56 2017 | LHC@home | Finished download of boinc_job_script.exK6Yg
Sam 16 sep 12:07:58 2017 | LHC@home | Sending scheduler request: To fetch work.
Sam 16 sep 12:07:58 2017 | LHC@home | Requesting new tasks for CPU
Sam 16 sep 12:07:59 2017 | LHC@home | Scheduler request completed: got 0 new tasks
Sam 16 sep 12:07:59 2017 | LHC@home | No tasks sent
Sam 16 sep 12:07:59 2017 | LHC@home | No tasks are available for ATLAS Simulation
Sam 16 sep 12:07:59 2017 | LHC@home | This computer has reached a limit on tasks in progress
Sam 16 sep 12:10:00 2017 | LHC@home | Finished download of jf_2fa1af40f9d9a1646e8156913db3dc9b
Sam 16 sep 12:10:01 2017 | LHC@home | [slot] assigning slot 0 to x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm_0
Sam 16 sep 12:10:01 2017 | | [slot] removed file slots/0/init_data.xml
Sam 16 sep 12:10:01 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/vboxwrapper_26196_x86_64-apple-darwin (input)
Sam 16 sep 12:10:01 2017 | LHC@home | [slot] linked ../../projects/lhcathome.cern.ch_lhcathome/vboxwrapper_26196_x86_64-apple-darwin to slots/0/vboxwrapper_26196_x86_64-apple-darwin
Sam 16 sep 12:10:01 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/ATLAS_2017_01_09.xml (input)
Sam 16 sep 12:10:01 2017 | LHC@home | [slot] linked ../../projects/lhcathome.cern.ch_lhcathome/ATLAS_2017_01_09.xml to slots/0/vbox_job.xml
Sam 16 sep 12:10:01 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/ATLASM_2017_03_01.vdi (input)
Sam 16 sep 12:10:01 2017 | LHC@home | Starting task x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm_0
Sam 16 sep 12:12:04 2017 | | [slot] removed file slots/0/init_data.xml
Sam 16 sep 12:12:04 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/vboxwrapper_26196_x86_64-apple-darwin (input)
Sam 16 sep 12:12:04 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/ATLAS_2017_01_09.xml (input)
Sam 16 sep 12:12:04 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/ATLASM_2017_03_01.vdi (input)
Sam 16 sep 12:12:04 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/jf_2fa1af40f9d9a1646e8156913db3dc9b (input)
Sam 16 sep 12:12:07 2017 | | [slot] removed file slots/0/init_data.xml
Sam 16 sep 12:12:07 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/vboxwrapper_26196_x86_64-apple-darwin (input)
Sam 16 sep 12:12:07 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/ATLAS_2017_01_09.xml (input)
Sam 16 sep 12:12:07 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/ATLASM_2017_03_01.vdi (input)
Sam 16 sep 12:12:07 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/jf_2fa1af40f9d9a1646e8156913db3dc9b (input)
Sam 16 sep 12:12:07 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm_input.tar.gz (input)
Sam 16 sep 12:12:07 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/rte_x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm.tar.gz (input)
Sam 16 sep 12:12:07 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/boinc_job_script.exK6Yg (input)
Sam 16 sep 12:12:07 2017 | | [slot] removed file slots/0/boinc_temporary_exit
Sam 16 sep 12:14:37 2017 | LHC@home | [slot] output file slots/0/shared/result.tar.gz missing, not copying
Sam 16 sep 12:14:37 2017 | | [slot] cleaning out slots/0: handle_exited_app()
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/boinc_finish_called
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/boinc_mmap_file
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/init_data.xml
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/shared/ATLAS.root
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/shared/init_data.xml
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/shared/input.tar.gz
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/shared/RTE.tar.gz
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/shared/start_atlas.sh
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/stderr.txt
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/vbox_checkpoint.xml
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/vbox_job.xml
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/vbox_remote_desktop.xml
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/vbox_replay.txt
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/vbox_trace.txt
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/vbox_webapi.xml
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/vboxwrapper_26196_x86_64-apple-darwin
Sam 16 sep 12:14:37 2017 | | [slot] removed file slots/0/vm_image.vdi
Sam 16 sep 12:14:37 2017 | LHC@home | Computation for task x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm_0 finished
Sam 16 sep 12:14:37 2017 | LHC@home | Output file x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm_0_ATLAS_result for task x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm_0 absent

Slots on BOINC Data local (good)
drwxrwxr-x 18 boinc_master boinc_project 612 16 sep 11:47 1
drwxrwxr-x 10 boinc_master boinc_project 340 16 sep 11:47 0
&
Slots on BOINC Data USB (bad)
drwxrwxr-x 4 boinc_master boinc_master 136 16 sep 12:21 0
drwxrwxr-x 10 boinc_master boinc_project 340 16 sep 12:17 1


Thks
ID: 81308 · Report as offensive     Reply Quote
PDW

Send message
Joined: 14 Aug 15
Posts: 45
United Kingdom
Message 81310 - Posted: 16 Sep 2017, 10:45:48 UTC - in response to Message 81308.  

Sam 16 sep 12:12:07 2017 | LHC@home | setup_file: projects/lhcathome.cern.ch_lhcathome/boinc_job_script.exK6Yg (input)
Sam 16 sep 12:12:07 2017 | | [slot] removed file slots/0/boinc_temporary_exit
Sam 16 sep 12:14:37 2017 | LHC@home | [slot] output file slots/0/shared/result.tar.gz missing, not copying

Looks to me like the application failed before even trying to create a result file, exited and then had a problem with copying the result file because there wasn't one.
ID: 81310 · Report as offensive     Reply Quote
Richard Haselgrove
Volunteer moderator
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 2560
United Kingdom
Message 81311 - Posted: 16 Sep 2017, 11:11:05 UTC - in response to Message 81308.  

Sam 16 sep 12:10:01 2017 | LHC@home | Starting task x6lLDm2SNDrnDDn7oo6G73TpABFKDmABFKDmiOLKDmABFKDmZVGOTm_0
There might be something in std_err.

Task 157411792 hasn't been reported yet. It might be worth keeping an eye on it - the previous task 156526891 has quite a lot of detail.
ID: 81311 · Report as offensive     Reply Quote
PhilTheNet

Send message
Joined: 30 Dec 14
Posts: 13
France
Message 81312 - Posted: 16 Sep 2017, 11:28:27 UTC - in response to Message 81311.  

Yes all units have the same error messages

Thks
ID: 81312 · Report as offensive     Reply Quote
Profile Ageless
Volunteer moderator
Project administrator
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 12233
Netherlands
Message 81313 - Posted: 16 Sep 2017, 11:48:43 UTC

Can you try to put the data directory back in its original place, to see if the errors then go away? Because if they then do not, this may be a project (application) problem.
It may be a coincidence that this started to happen at this time.
Jord
Please do not private message me for tech support. Use the forums for that. Tech PMs will be ignored.
ID: 81313 · Report as offensive     Reply Quote
PhilTheNet

Send message
Joined: 30 Dec 14
Posts: 13
France
Message 81314 - Posted: 16 Sep 2017, 11:52:38 UTC - in response to Message 81310.  
Last modified: 16 Sep 2017, 11:54:26 UTC

For PDW
No, same msg on a working config :

Sam 16 sep 13:49:48 2017 | | [slot] removed file slots/1/boinc_temporary_exit
Sam 16 sep 13:49:48 2017 | | [slot] removed file slots/0/init_data.xml


Thks
ID: 81314 · Report as offensive     Reply Quote
PhilTheNet

Send message
Joined: 30 Dec 14
Posts: 13
France
Message 81315 - Posted: 16 Sep 2017, 11:57:27 UTC - in response to Message 81313.  

I just did the manipulation, but as I said in the introduction everything works well with the internal drive

It's just when I want to walk the same config with the same projects on the disk usb that only projects using Vb bug

Thks
ID: 81315 · Report as offensive     Reply Quote
PDW

Send message
Joined: 14 Aug 15
Posts: 45
United Kingdom
Message 81316 - Posted: 16 Sep 2017, 12:00:57 UTC - in response to Message 81314.  

For PDW
No, same msg on a working config :

Sam 16 sep 13:49:48 2017 | | [slot] removed file slots/1/boinc_temporary_exit
Sam 16 sep 13:49:48 2017 | | [slot] removed file slots/0/init_data.xml


Thks

If that is from a single task I wouldn't have thought it should be using slots 0 and 1 at the same time !

Also these tasks take a while to get set up and run and these were failing straight away.
ID: 81316 · Report as offensive     Reply Quote
PhilTheNet

Send message
Joined: 30 Dec 14
Posts: 13
France
Message 81317 - Posted: 16 Sep 2017, 12:13:22 UTC - in response to Message 81316.  

copy/paste error :

Sam 16 sep 13:49:48 2017 | | [slot] removed file slots/1/boinc_temporary_exit

slot 1 => LHC who calculate without error

Thks
ID: 81317 · Report as offensive     Reply Quote
Profile Ageless
Volunteer moderator
Project administrator
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 12233
Netherlands
Message 81318 - Posted: 16 Sep 2017, 12:52:55 UTC

I asked the Mac developer for advice. He agrees with me it is a permission problem for VirtualBox.
If the ownership of the slot 0 directory is user boinc_master and group boinc_master, then projects cannot write into the directory with the permissions shown.

Perhaps rerun the Mac_SHA_secure.sh script?
One other thing it could be is the bug that's in 7.8.2 which causes the client to not clean up the slot directories and it reusing them while there are still other files in there. There is no client out yet with a fix for that and I don't know how many versions you should go back to be before that bug was introduced. (Richard?)
Jord
Please do not private message me for tech support. Use the forums for that. Tech PMs will be ignored.
ID: 81318 · Report as offensive     Reply Quote
Richard Haselgrove
Volunteer moderator
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 2560
United Kingdom
Message 81323 - Posted: 16 Sep 2017, 14:38:22 UTC - in response to Message 81318.  

One other thing it could be is the bug that's in 7.8.2 which causes the client to not clean up the slot directories and it reusing them while there are still other files in there. There is no client out yet with a fix for that and I don't know how many versions you should go back to be before that bug was introduced. (Richard?)
That bug was for Windows only, so not relevant here.

For the record, it was introduced on Jan 31 this year (2017, for readers in the future) with commit bbd34f70d315336310e82b8d651730f1913a2778 - so any v7.6 release will be clear of it.
ID: 81323 · Report as offensive     Reply Quote

Message boards : Questions and problems : BOINC Data on USB HDD

Copyright © 2017 University of California. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.