Thread 'Whats the best way to use BOINC with a big Python library?'

Message boards : API : Whats the best way to use BOINC with a big Python library?
Message board moderation

To post messages, you must log in.

AuthorMessage
Joao Paulo

Send message
Joined: 15 Jan 14
Posts: 3
Brazil
Message 51995 - Posted: 15 Jan 2014, 19:43:46 UTC

Hello, I'm making a BOINC project with the pDynamo program (molecular modeling) https://sites.google.com/site/pdynamomodeling/ . It is a big library of Python and C. It runs via Python scripts (input.py), and writes an output.

I read on the wiki that I can use pyBOINC, but PyBOINC is not maintained. Can I use vboxwrapper, with a virtual machine with the library compiled inside?

I can't use py2exe since i will run on unix guests and it is a library made of python, c and cython.

I already have the server up and running!

Are there any other options? Will the vboxwrapper work?

Thank you.
J
ID: 51995 · Report as offensive
kvn1961
Avatar

Send message
Joined: 9 Jul 12
Posts: 2
Australia
Message 51998 - Posted: 16 Jan 2014, 6:11:32 UTC - in response to Message 51995.  

The only one I know about would be vboxwrapper

In theory you could create a python virtualenv for each OS and copy that, but it'd be rather difficult (perhaps a nightmare) to administer
Regards
Kevin
-------------
theSkyNet POGS
http://pogs.theskynet.org/pogs
ID: 51998 · Report as offensive
ChristianB
Volunteer developer
Volunteer tester

Send message
Joined: 4 Jul 12
Posts: 321
Germany
Message 52001 - Posted: 16 Jan 2014, 19:54:04 UTC

The vboxwrapper approach would be the best in this case. You should create your VM with all the libraries and executables installed. Make sure this is not too big and give it a try. How long are your computations? The vboxwrapper is currently not so friendly with longer computation times. But this is going to be fixed in the near future.
ID: 52001 · Report as offensive
Joao Paulo

Send message
Joined: 15 Jan 14
Posts: 3
Brazil
Message 52008 - Posted: 17 Jan 2014, 12:56:17 UTC

Hi, thanks for the feedback.

My computations will not take more than 2hours/user, is it ok for the vbox?

I will now configure the VM!
ID: 52008 · Report as offensive
Joao Paulo

Send message
Joined: 15 Jan 14
Posts: 3
Brazil
Message 52009 - Posted: 17 Jan 2014, 13:17:17 UTC

And another question!

Since its a library I don't really have a "boinc_app" to monitor. I will just call the input scripts. The input would be the "boinc_app".

I'm thinking on doing a really simple program that just calls the input file via command line and waits till a output file is written. Is this the best solution? Is it possible to just copy the input file as a "boinc_app"?
ID: 52009 · Report as offensive
ChristianB
Volunteer developer
Volunteer tester

Send message
Joined: 4 Jul 12
Posts: 321
Germany
Message 52080 - Posted: 22 Jan 2014, 7:29:50 UTC

The "boinc_app" can be a script of course. It just has to be executable. At RNAWorld we have a batch script that calls the real executable, monitors the memory usage and copies the output files into the right place so the client can find them.

You should also implement something like this if only to use it later. You have to make sure that the output files are in the shared/ folder and have the correct name that is specified in the output template.

If you are calling scripts make sure not to execute them inside the shared/ folder as this will not work with snapshots.
ID: 52080 · Report as offensive

Message boards : API : Whats the best way to use BOINC with a big Python library?

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.