Thread 'How to make the WrapperApp to work?'

Message boards : API : How to make the WrapperApp to work?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
rebirther
Avatar

Send message
Joined: 21 Jun 06
Posts: 156
Germany
Message 48694 - Posted: 19 Apr 2013, 17:01:19 UTC - in response to Message 48692.  

This is the latest error message:

That error message is typical if the file has been compressed with a newer version or zip utility, using features - typically a better compression ratio - that an older unzip utility doesn't recognise.

Try making the utopia1_26012_windows_x86_64__opencl_nvidia_100.zip file again from the original sources, using less aggressive/more compatible compression settings, or an older utility.


I unzipped the files from utopia1_26012_windows_x86_64__opencl_nvidia_100.zip and zipped them again using a very old version of WinZip and 8+3-settings. It still doesn't seem to work. :/

Is this really the end for my project? I wouldn't want to give up because of a zip file.


The easiest way is to add all files into the version x folder and let BOINC download all.
ID: 48694 · Report as offensive
HTH

Send message
Joined: 8 Aug 06
Posts: 30
Finland
Message 48701 - Posted: 19 Apr 2013, 18:44:17 UTC - in response to Message 48694.  


The easiest way is to add all files into the version x folder and let BOINC download all.


19.4.2013 21:42:13 | test | Master file download succeeded
19.4.2013 21:42:18 | test | Sending scheduler request: Project initialization.
19.4.2013 21:42:18 | test | Requesting new tasks for CPU and NVIDIA
19.4.2013 21:42:19 | test | Scheduler request completed: got 1 new tasks
19.4.2013 21:42:21 | test | Started download of utopia1_26016_windows_x86_64__opencl_nvidia_100.exe
19.4.2013 21:42:21 | test | Started download of phoenix.exe
19.4.2013 21:42:22 | test | Finished download of utopia1_26016_windows_x86_64__opencl_nvidia_100.exe
19.4.2013 21:42:22 | test | Finished download of phoenix.exe
19.4.2013 21:42:22 | test | Started download of phoenix_job_1.16.xml
19.4.2013 21:42:22 | test | Started download of example.cfg
19.4.2013 21:42:23 | test | Finished download of phoenix_job_1.16.xml
19.4.2013 21:42:23 | test | Finished download of example.cfg
19.4.2013 21:42:23 | test | Started download of rpc.txt
19.4.2013 21:42:23 | test | Started download of cpu.py
19.4.2013 21:42:25 | test | Finished download of rpc.txt
19.4.2013 21:42:25 | test | Finished download of cpu.py
19.4.2013 21:42:25 | test | Started download of opencl
19.4.2013 21:42:25 | test | Started download of phatk2
19.4.2013 21:42:26 | test | Giving up on download of opencl: permanent HTTP error
19.4.2013 21:42:26 | test | Giving up on download of phatk2: permanent HTTP error
19.4.2013 21:42:26 | test | Started download of phoenix.cfg
19.4.2013 21:42:27 | test | Finished download of phoenix.cfg

Subdirectories are not allowed in location "/home/boincadm/projects/test/apps/utopia1/26016/windows_x86_64__opencl_nvidia_100"?
ID: 48701 · Report as offensive
rebirther
Avatar

Send message
Joined: 21 Jun 06
Posts: 156
Germany
Message 48702 - Posted: 19 Apr 2013, 18:50:17 UTC - in response to Message 48701.  


The easiest way is to add all files into the version x folder and let BOINC download all.


19.4.2013 21:42:13 | test | Master file download succeeded
19.4.2013 21:42:18 | test | Sending scheduler request: Project initialization.
19.4.2013 21:42:18 | test | Requesting new tasks for CPU and NVIDIA
19.4.2013 21:42:19 | test | Scheduler request completed: got 1 new tasks
19.4.2013 21:42:21 | test | Started download of utopia1_26016_windows_x86_64__opencl_nvidia_100.exe
19.4.2013 21:42:21 | test | Started download of phoenix.exe
19.4.2013 21:42:22 | test | Finished download of utopia1_26016_windows_x86_64__opencl_nvidia_100.exe
19.4.2013 21:42:22 | test | Finished download of phoenix.exe
19.4.2013 21:42:22 | test | Started download of phoenix_job_1.16.xml
19.4.2013 21:42:22 | test | Started download of example.cfg
19.4.2013 21:42:23 | test | Finished download of phoenix_job_1.16.xml
19.4.2013 21:42:23 | test | Finished download of example.cfg
19.4.2013 21:42:23 | test | Started download of rpc.txt
19.4.2013 21:42:23 | test | Started download of cpu.py
19.4.2013 21:42:25 | test | Finished download of rpc.txt
19.4.2013 21:42:25 | test | Finished download of cpu.py
19.4.2013 21:42:25 | test | Started download of opencl
19.4.2013 21:42:25 | test | Started download of phatk2
19.4.2013 21:42:26 | test | Giving up on download of opencl: permanent HTTP error
19.4.2013 21:42:26 | test | Giving up on download of phatk2: permanent HTTP error
19.4.2013 21:42:26 | test | Started download of phoenix.cfg
19.4.2013 21:42:27 | test | Finished download of phoenix.cfg

Subdirectories are not allowed in location "/home/boincadm/projects/test/apps/utopia1/26016/windows_x86_64__opencl_nvidia_100"?


There must be all files in one folder. I think subdirectories are not allowed.
ID: 48702 · Report as offensive
HTH

Send message
Joined: 8 Aug 06
Posts: 30
Finland
Message 48749 - Posted: 21 Apr 2013, 20:41:41 UTC - in response to Message 48702.  
Last modified: 21 Apr 2013, 20:48:19 UTC


There must be all files in one folder. I think subdirectories are not allowed.


Okay. So I have to find a bitcoin miner with no subdirectories?

Okay. I think I found it.

These are all the files:
bitcoinminercuda_10.cubin
bitcoinminercuda_11.cubin
bitcoinminercuda_20.cubin
bitcoinmineropencl.cl
cudart32_32_16.dll
curllib.dll
gpl-2.0.txt
libeay32.dll
libsasl.dll
license.txt
openldap.dll
readme.txt
rpcminer-4way.exe
rpcminer-cpu.exe
rpcminer-cuda.exe
rpcminer-opencl.exe
ssleay32.dll

Should I put all those files in the directory /home/boincadm/projects/test/apps/utopia1/26018/windows_x86__cuda?

Can you, please, help me to make a working BOINC application? The worker has to be either rpcminer-cuda.exe or rpcminer-opencl.exe. Can you help me to write the correct version.xml, job.xml and project.xml files?

Should I still use this http://boinc.berkeley.edu/dl/wrapper_26002_windows_x86_64.zip as a wrapper?
ID: 48749 · Report as offensive
Profileyoyo
Avatar

Send message
Joined: 23 May 06
Posts: 41
Germany
Message 48750 - Posted: 21 Apr 2013, 20:51:07 UTC

Please run your boinc with --exit_before_start and run a workunit. Boinc will setup the slot directory and exits before starting the wu.

Than send me the slot folder and the project folder.

Check if you have everything what you expect in the slot folder.
Than you can just copy over the wrapper from the project folder into the slot folder and run it.
Afterwards check the std* files.

yoyo
Germany biggest distributed computing community Rechenkraft.net
ID: 48750 · Report as offensive
HTH

Send message
Joined: 8 Aug 06
Posts: 30
Finland
Message 48753 - Posted: 21 Apr 2013, 21:32:23 UTC - in response to Message 48750.  

Please run your boinc with --exit_before_start and run a workunit. Boinc will setup the slot directory and exits before starting the wu.

Than send me the slot folder and the project folder.

Check if you have everything what you expect in the slot folder.
Than you can just copy over the wrapper from the project folder into the slot folder and run it.
Afterwards check the std* files.

yoyo


Ok. I will do that next.
ID: 48753 · Report as offensive
Dotsch
Avatar

Send message
Joined: 11 Oct 06
Posts: 83
Germany
Message 48763 - Posted: 22 Apr 2013, 7:36:40 UTC - in response to Message 48692.  
Last modified: 22 Apr 2013, 7:37:18 UTC


Is this really the end for my project? I wouldn't want to give up because of a zip file.

No.

I have made an "unzip wrapper" for the BOINC wrapper for the Constellation project, which unpacks a 7z archive in the first step, and then starts the application according job.xml.
If you don't solve this issue, I can share the it with you. But, I have got to make some small modification, that it will generally work on other project.
ID: 48763 · Report as offensive
HTH

Send message
Joined: 8 Aug 06
Posts: 30
Finland
Message 48765 - Posted: 22 Apr 2013, 11:47:56 UTC - in response to Message 48763.  


Is this really the end for my project? I wouldn't want to give up because of a zip file.

No.

I have made an "unzip wrapper" for the BOINC wrapper for the Constellation project, which unpacks a 7z archive in the first step, and then starts the application according job.xml.
If you don't solve this issue, I can share the it with you. But, I have got to make some small modification, that it will generally work on other project.


Thanks! I'd really love to see your unzip wrapper.
ID: 48765 · Report as offensive
Profileyoyo
Avatar

Send message
Joined: 23 May 06
Posts: 41
Germany
Message 48766 - Posted: 22 Apr 2013, 13:28:08 UTC - in response to Message 48765.  

You can also, what I did because there was no unzip possibility in the wrapper in the past, add an additional TASK in your job.xml which runs the unzip. But with this you must deliver the unzip binary also in your application.

yoyo
Germany biggest distributed computing community Rechenkraft.net
ID: 48766 · Report as offensive
Profileyoyo
Avatar

Send message
Joined: 23 May 06
Posts: 41
Germany
Message 48777 - Posted: 23 Apr 2013, 7:22:05 UTC - in response to Message 48766.  

I tested what you send me. You started boinc with --exit_before_start. In this case everything is in your slot folder. Some of the files are sym links to the project folder.

I resolved the symlinks by copying the files from projects folder into the slot folder.
Than I started the wrapper on the command line.
The zip file was unziped and the folders doc and plugins and files in these folders were created.
So UNZIP SUBFOLDERS WORKS!

Afterwards phoenix.exe was started.

dir:
a>ls -lR
ls -lR
total 7789
-rwxrwxrwx  1                         0 Apr 23 09:15 boinc_lockfile                                        
drwxrwxrwx  1                         0 Apr 18 09:29 doc                                                   
-rwxrwxrwx  1                       201 Apr 21 23:35 job.xml                                               
-rwxrwxrwx  1                       252 Apr 21 23:35 phoenix.cfg                                           
-rwxrwxrwx  1                   6639870 Apr  7  2012 phoenix.exe                                           
-rwxrwxrwx  1                      1093 Apr 23 09:16 phoenix.log                                           
drwxrwxrwx  1                         0 Apr 18 09:29 plugins                                               
-rwxrwxrwx  1                       202 Apr 23 09:15 stderr.txt                                            
-rwxrwxrwx  1                   1335296 Apr 21 23:35 utopia1_26012_windows_x86_64__opencl_nvidia_100.exe   


d:\yoyo\dropbox\henri\test\a\doc:
total 11
-rwxrwxrwx  1                      6847 Feb 21  2012 cpu.py                                                
-rwxrwxrwx  1                      2325 Feb 22  2012 example.cfg                                           
-rwxrwxrwx  1                      2853 Mar  9  2012 rpc.txt                                               


d:\yoyo\dropbox\henri\test\a\plugins:
total 0
drwxrwxrwx  1                         0 Apr 23 09:15 opencl                                                
drwxrwxrwx  1                         0 Apr 23 09:15 phatk2                                                


d:\yoyo\dropbox\henri\test\a\plugins\opencl:
total 62
-rwxrwxrwx  1                     20185 Apr  7  2012 __init__.py                                           
-rwxrwxrwx  1                     13700 Apr 23 09:15 __init__.pyo                                          
-rwxrwxrwx  1                     30967 Feb 21  2012 kernel.cl                                             


d:\yoyo\dropbox\henri\test\a\plugins\phatk2:
total 27
-rwxrwxrwx  1                      9587 Feb 26  2012 __init__.py                                           
-rwxrwxrwx  1                      6675 Apr 23 09:15 __init__.pyo                                          
-rwxrwxrwx  1                     11982 Feb 15  2012 kernel.cl                                             


a>


stderr.txt:
09:15:41 (15068): Can't open init data file - running in standalone mode
wrapper: starting
09:15:41 (15068): unexpected tag in job.xml: zipfilename
09:15:43 (15068): wrapper: running phoenix.exe ()

[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[04/23/2013 09:15:46] Welcome to Phoenix v2.0.0     
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[09:15:46] Failed to load plugin "opencl"           
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[09:15:46] Failed to load plugin "phatk2"           
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[09:15:52] Couldn't connect to server, switching backend...
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[09:15:57] Couldn't connect to server, switching backend...
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[09:16:02] Couldn't connect to server, switching backend...
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[09:16:07] Couldn't connect to server, switching backend...


phoenix.log:
[04/23/2013 09:15:46] Welcome to Phoenix v2.0.0
[04/23/2013 09:15:46] Failed to load plugin "opencl"
[04/23/2013 09:15:46] Failed to load plugin "phatk2"
[04/23/2013 09:15:52] Couldn't connect to server, switching backend...
[04/23/2013 09:15:57] Couldn't connect to server, switching backend...
[04/23/2013 09:16:02] Couldn't connect to server, switching backend...
[04/23/2013 09:16:07] Couldn't connect to server, switching backend...
[04/23/2013 09:16:12] Couldn't connect to server, switching backend...
[04/23/2013 09:16:17] Couldn't connect to server, switching backend...
[04/23/2013 09:16:22] Couldn't connect to server, switching backend...


yoyo
Germany biggest distributed computing community Rechenkraft.net
ID: 48777 · Report as offensive
HTH

Send message
Joined: 8 Aug 06
Posts: 30
Finland
Message 48796 - Posted: 24 Apr 2013, 8:17:00 UTC - in response to Message 48777.  

I tested what you send me. You started boinc with --exit_before_start. In this case everything is in your slot folder. Some of the files are sym links to the project folder.

I resolved the symlinks by copying the files from projects folder into the slot folder.
Than I started the wrapper on the command line.
The zip file was unziped and the folders doc and plugins and files in these folders were created.
So UNZIP SUBFOLDERS WORKS!


Thanks, yoyo! I also got it to work (I think) after manually copying the files and starting it from the command line. But it still doesn't work on BOINC. It doesn't recognize the zip file.

What is wrapper_26003_windows_x86_64.pdb? What is this pdb file? Is it necessary for the wrapper application to work? I didn't include that in my app folder. Is that the cause of the problem?
ID: 48796 · Report as offensive
HTH

Send message
Joined: 8 Aug 06
Posts: 30
Finland
Message 48798 - Posted: 24 Apr 2013, 8:40:55 UTC - in response to Message 48796.  
Last modified: 24 Apr 2013, 8:45:19 UTC


What is wrapper_26003_windows_x86_64.pdb? What is this pdb file? Is it necessary for the wrapper application to work? I didn't include that in my app folder. Is that the cause of the problem?


Yes, I think it really is! I made a step forward after putting utopia1_26020_windows_x86_64__opencl_nvidia_100.pdb in the app folder:
Stderr output
<core_client_version>7.0.46</core_client_version>
<![CDATA[
<message>
er - exit code 195 (0xc3)
</message>
<stderr_txt>
wrapper: starting
11:29:14 (7732): unexpected tag in job.xml: zipfilename
11:29:14 (7732): wrapper: running ../../projects/192.168.1.119_test/phoenix.exe ()

[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[04/24/2013 11:29:15] Welcome to Phoenix v2.0.0     
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]Traceback (most recent call last):
  File "phoenix.py", line 6, in <module>
  File "phoenix2\__init__.pyo", line 51, in main
  File "phoenix2\core\PhoenixCore.pyo", line 90, in start
  File "phoenix2\core\PhoenixCore.pyo", line 144, in discoverPlugins
WindowsError: [Error 3] M&#228;&#228;ritetty&#228; polkua ei l&#246;ydy: 'C:\\ProgramData\\BOINC\\projects\\192.168.1.119_test\\plugins/*.*'

                                                      close failed in file object destructor:
sys.excepthook is missing
lost sys.stderr
app exit status: 0xff
11:29:15 (7732): called boinc_finish

</stderr_txt>
]]>


I think I saw the subdirectories in the slot folder!

Now, I still need to figure out how to make phoenix.exe (the worker program) to access those subdirectories. As you can see, it tells that plugins folder (the necessary subdirectory for phoenix.exe to run) is missing.

Any tips? I can't see the subdirectories in the project folder...
ID: 48798 · Report as offensive
ChristianB
Volunteer developer
Volunteer tester

Send message
Joined: 4 Jul 12
Posts: 321
Germany
Message 48799 - Posted: 24 Apr 2013, 9:11:19 UTC

The subdirectories should exist in the slot folder only. There is also a new wrapper available. The pdb file is usually only needed for debugging. If the error is wrong symlinking than you may check if those files have the proper copy_file attribute set. And also please check that all application specific files go into the apps folder and have to be specified in the version.xml and all workunit specific files (the phoenix.cfg in your case) go into the input template files and also need the copy_file attribute. I haven't checked your templates in detail but keep in mind that you have to generate new worknits after changing the template files and you have to create a new app_version (by running update_versions) everytime you change your version.xml Copy the whole apps folder in a new version directory (e.g. increase the 26020 to 26021) and make your changes there.
ID: 48799 · Report as offensive
Previous · 1 · 2

Message boards : API : How to make the WrapperApp to work?

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.