Posts by HTH

1) Message boards : Server programs : Server sends workunits, users can't see them (Message 53831)
Posted 29 Apr 2014 by HTH
Post:
I have a problem with application "CudaMiner 2014-02-28 (Campaign #1)" in my BOINC server: http://www.bitcoinutopia.net/bitcoinutopia

The platform and plan class for the app is: windows_intelx86__cuda

The server sends workunits to users for that application but the workunits can't be seen on the BOINC Manager and they won't run. What instructions should I give to users for testing?

Henri.
2) Message boards : Web interfaces : Minimum amount of credit to post, checkboxes for cancelling workunits, changing user_friendly_name (Message 53720)
Posted 19 Apr 2014 by HTH
Post:
http://boinc.berkeley.edu/trac/wiki/ProtectionFromSpam
Minimum credit to post

You can require that users have a minimum amount of credit to post on a forum using the following database fields:

forum.post_min_expavg_credit
users must have this amount of average credit to post on the forum
forum.post_min_total_credit
users must have this amount of total credit to post on the forum
There is currently no web interface for these; you have to set them manually using mysql or phpMyAdmin. These fields are at the forum level so that, for example, you can protect some forums while leaving a "Help" forum open.


I have these wishes:
- a web interface for setting a minimum amount of credit to post on a forum

- a web interface for cancelling workunits with checkboxes:
[ ] WU 123456
[X] WU 123457
[ ] WU 123499
[ ] WU 123506
[X] WU 123555

- a web interface for changing application names (user_friendly_name?) easily. I changed them in the project.xml and run bin/xadd and bin/update_versions but the old name is still there in the server status page.

Thanks!

Henri.
3) Message boards : Web interfaces : remove postings (Message 53683)
Posted 17 Apr 2014 by HTH
Post:
I added this feature.
-- David


Thanks!

Henri.
4) Message boards : Projects : Bitcoin Utopia: New URL (Message 49863)
Posted 14 Jul 2013 by HTH
Post:
The new URL for Bitcoin Utopia is http://www.bitcoinutopia.com/.

Henri.
5) Message boards : Server programs : ./test/test_sanity.py fails (Message 49259)
Posted 22 May 2013 by HTH
Post:
I saw your mail on boinc_projects, but I'm very busy this week. So here is it in short. Everything in test/ is old and deprecated. If make succeeds than you have a (somehow) working source and can run make_project with the appropriate options. Options are here: http://boinc.berkeley.edu/trac/wiki/MakeProject
A more explainative tutorial-like description is in the cookbook: http://boinc.berkeley.edu/trac/wiki/CreateProjectCookbook This is for Debain based systems! You may have to change some commands for other distributions.

Regards
Christian


Thanks for the reply.

I got it to work! It just works. :)
6) Message boards : Server programs : ./test/test_sanity.py fails (Message 49239)
Posted 22 May 2013 by HTH
Post:
I'm trying to set up a BOINC server. This is what I get after ./test/test_sanity.py
-- Testing framework sanity --------------------------------------------------
Traceback (most recent call last):
  File "./test/test_sanity.py", line 34, in <module>
    test_msg("framework sanity")
  File "/home/boincadm/boinc-v2/test/testbase.py", line 759, in test_msg
    test_init()
  File "/home/boincadm/boinc-v2/test/testbase.py", line 30, in test_init
    os.chdir(os.path.join(os.getenv('srcdir'),'test'))
  File "/usr/lib/python2.7/posixpath.py", line 68, in join
    elif path == '' or path.endswith('/'):
AttributeError: 'NoneType' object has no attribute 'endswith'
 
Exception thrown - bug in test scripts?
ERRORS.COUNT: 1
Error in atexit._run_exitfuncs:
Traceback (most recent call last):
  File "/usr/lib/python2.7/atexit.py", line 24, in _run_exitfuncs
    func(*targs, **kargs)
  File "/home/boincadm/boinc-v2/test/testbase.py", line 788, in osexit_test_done
    os._exit(test_done())
  File "/home/boincadm/boinc-v2/test/testbase.py", line 772, in test_done
    if options.delete_testbed == 'always':
AttributeError: Options instance has no attribute 'delete_testbed'
Error in sys.exitfunc:
Traceback (most recent call last):
  File "/usr/lib/python2.7/atexit.py", line 24, in _run_exitfuncs
    func(*targs, **kargs)
  File "/home/boincadm/boinc-v2/test/testbase.py", line 788, in osexit_test_done
    os._exit(test_done())
  File "/home/boincadm/boinc-v2/test/testbase.py", line 772, in test_done
    if options.delete_testbed == 'always':
AttributeError: Options instance has no attribute 'delete_testbed'


This is how I tried to set up the server:
apt-cache search "^language-pack-[a-z][a-z]$"
sudo apt-get update
sudo apt-get install language-pack-fi
sudo apt-get upgrade
sudo nano ~/.bash_profile
----
export LC_CTYPE="fi_FI.UTF-8"
----
sudo nano /etc/default/useradd
----
SHELL=/bin/bash
HOME=/home
----
sudo useradd -d /home/boincadm -m boincadm
sudo passwd boincadm
sudo passwd root
sudo nano /etc/sudoers
----
# User privilege specification
root    ALL=(ALL:ALL) ALL
boincadm ALL=(ALL) ALL
----
su boincadm
cd /home/boincadm
sudo usermod -aG boincadm www-data
sudo apt-get install git build-essential apache2 php5 mysql-server php5-gd php5-cli php5-mysql python-mysqldb libtool automake autoconf pkg-config libmysql++-dev libssl-dev
git clone git://boinc.berkeley.edu/boinc-v2.git
mysql -u root -p
GRANT ALL ON *.* TO 'boincadm'@'localhost';
SELECT * FROM mysql.user WHERE user='boincadm';
EXIT
cd boinc-v2
./_autosetup
./configure --enable-server --disable-client --disable-manager
make
./test/test_sanity.py
7) Message boards : API : How to make the WrapperApp to work? (Message 48798)
Posted 24 Apr 2013 by HTH
Post:

What is wrapper_26003_windows_x86_64.pdb? What is this pdb file? Is it necessary for the wrapper application to work? I didn't include that in my app folder. Is that the cause of the problem?


Yes, I think it really is! I made a step forward after putting utopia1_26020_windows_x86_64__opencl_nvidia_100.pdb in the app folder:
Stderr output
<core_client_version>7.0.46</core_client_version>
<![CDATA[
<message>
er - exit code 195 (0xc3)
</message>
<stderr_txt>
wrapper: starting
11:29:14 (7732): unexpected tag in job.xml: zipfilename
11:29:14 (7732): wrapper: running ../../projects/192.168.1.119_test/phoenix.exe ()

[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[04/24/2013 11:29:15] Welcome to Phoenix v2.0.0     
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]Traceback (most recent call last):
  File "phoenix.py", line 6, in <module>
  File "phoenix2\__init__.pyo", line 51, in main
  File "phoenix2\core\PhoenixCore.pyo", line 90, in start
  File "phoenix2\core\PhoenixCore.pyo", line 144, in discoverPlugins
WindowsError: [Error 3] M&#228;&#228;ritetty&#228; polkua ei l&#246;ydy: 'C:\\ProgramData\\BOINC\\projects\\192.168.1.119_test\\plugins/*.*'

                                                      close failed in file object destructor:
sys.excepthook is missing
lost sys.stderr
app exit status: 0xff
11:29:15 (7732): called boinc_finish

</stderr_txt>
]]>


I think I saw the subdirectories in the slot folder!

Now, I still need to figure out how to make phoenix.exe (the worker program) to access those subdirectories. As you can see, it tells that plugins folder (the necessary subdirectory for phoenix.exe to run) is missing.

Any tips? I can't see the subdirectories in the project folder...
8) Message boards : API : How to make the WrapperApp to work? (Message 48796)
Posted 24 Apr 2013 by HTH
Post:
I tested what you send me. You started boinc with --exit_before_start. In this case everything is in your slot folder. Some of the files are sym links to the project folder.

I resolved the symlinks by copying the files from projects folder into the slot folder.
Than I started the wrapper on the command line.
The zip file was unziped and the folders doc and plugins and files in these folders were created.
So UNZIP SUBFOLDERS WORKS!


Thanks, yoyo! I also got it to work (I think) after manually copying the files and starting it from the command line. But it still doesn't work on BOINC. It doesn't recognize the zip file.

What is wrapper_26003_windows_x86_64.pdb? What is this pdb file? Is it necessary for the wrapper application to work? I didn't include that in my app folder. Is that the cause of the problem?
9) Message boards : API : How to make the WrapperApp to work? (Message 48765)
Posted 22 Apr 2013 by HTH
Post:

Is this really the end for my project? I wouldn't want to give up because of a zip file.

No.

I have made an "unzip wrapper" for the BOINC wrapper for the Constellation project, which unpacks a 7z archive in the first step, and then starts the application according job.xml.
If you don't solve this issue, I can share the it with you. But, I have got to make some small modification, that it will generally work on other project.


Thanks! I'd really love to see your unzip wrapper.
10) Message boards : API : How to make the WrapperApp to work? (Message 48753)
Posted 21 Apr 2013 by HTH
Post:
Please run your boinc with --exit_before_start and run a workunit. Boinc will setup the slot directory and exits before starting the wu.

Than send me the slot folder and the project folder.

Check if you have everything what you expect in the slot folder.
Than you can just copy over the wrapper from the project folder into the slot folder and run it.
Afterwards check the std* files.

yoyo


Ok. I will do that next.
11) Message boards : API : How to make the WrapperApp to work? (Message 48749)
Posted 21 Apr 2013 by HTH
Post:

There must be all files in one folder. I think subdirectories are not allowed.


Okay. So I have to find a bitcoin miner with no subdirectories?

Okay. I think I found it.

These are all the files:
bitcoinminercuda_10.cubin
bitcoinminercuda_11.cubin
bitcoinminercuda_20.cubin
bitcoinmineropencl.cl
cudart32_32_16.dll
curllib.dll
gpl-2.0.txt
libeay32.dll
libsasl.dll
license.txt
openldap.dll
readme.txt
rpcminer-4way.exe
rpcminer-cpu.exe
rpcminer-cuda.exe
rpcminer-opencl.exe
ssleay32.dll

Should I put all those files in the directory /home/boincadm/projects/test/apps/utopia1/26018/windows_x86__cuda?

Can you, please, help me to make a working BOINC application? The worker has to be either rpcminer-cuda.exe or rpcminer-opencl.exe. Can you help me to write the correct version.xml, job.xml and project.xml files?

Should I still use this http://boinc.berkeley.edu/dl/wrapper_26002_windows_x86_64.zip as a wrapper?
12) Message boards : API : How to make the WrapperApp to work? (Message 48701)
Posted 19 Apr 2013 by HTH
Post:

The easiest way is to add all files into the version x folder and let BOINC download all.


19.4.2013 21:42:13 | test | Master file download succeeded
19.4.2013 21:42:18 | test | Sending scheduler request: Project initialization.
19.4.2013 21:42:18 | test | Requesting new tasks for CPU and NVIDIA
19.4.2013 21:42:19 | test | Scheduler request completed: got 1 new tasks
19.4.2013 21:42:21 | test | Started download of utopia1_26016_windows_x86_64__opencl_nvidia_100.exe
19.4.2013 21:42:21 | test | Started download of phoenix.exe
19.4.2013 21:42:22 | test | Finished download of utopia1_26016_windows_x86_64__opencl_nvidia_100.exe
19.4.2013 21:42:22 | test | Finished download of phoenix.exe
19.4.2013 21:42:22 | test | Started download of phoenix_job_1.16.xml
19.4.2013 21:42:22 | test | Started download of example.cfg
19.4.2013 21:42:23 | test | Finished download of phoenix_job_1.16.xml
19.4.2013 21:42:23 | test | Finished download of example.cfg
19.4.2013 21:42:23 | test | Started download of rpc.txt
19.4.2013 21:42:23 | test | Started download of cpu.py
19.4.2013 21:42:25 | test | Finished download of rpc.txt
19.4.2013 21:42:25 | test | Finished download of cpu.py
19.4.2013 21:42:25 | test | Started download of opencl
19.4.2013 21:42:25 | test | Started download of phatk2
19.4.2013 21:42:26 | test | Giving up on download of opencl: permanent HTTP error
19.4.2013 21:42:26 | test | Giving up on download of phatk2: permanent HTTP error
19.4.2013 21:42:26 | test | Started download of phoenix.cfg
19.4.2013 21:42:27 | test | Finished download of phoenix.cfg

Subdirectories are not allowed in location "/home/boincadm/projects/test/apps/utopia1/26016/windows_x86_64__opencl_nvidia_100"?
13) Message boards : API : How to make the WrapperApp to work? (Message 48692)
Posted 19 Apr 2013 by HTH
Post:
This is the latest error message:

That error message is typical if the file has been compressed with a newer version or zip utility, using features - typically a better compression ratio - that an older unzip utility doesn't recognise.

Try making the utopia1_26012_windows_x86_64__opencl_nvidia_100.zip file again from the original sources, using less aggressive/more compatible compression settings, or an older utility.


I unzipped the files from utopia1_26012_windows_x86_64__opencl_nvidia_100.zip and zipped them again using a very old version of WinZip and 8+3-settings. It still doesn't seem to work. :/

Is this really the end for my project? I wouldn't want to give up because of a zip file.
14) Message boards : API : How to make the WrapperApp to work? (Message 48688)
Posted 19 Apr 2013 by HTH
Post:
Do you have any tips for my zip problem? Can I use external unzip program to unzip the zip file into the slot directory (automatically after the download is complete)? Where can I get the precompiled and free unzip for that?

This is the latest error message:
<core_client_version>7.0.46</core_client_version>
<![CDATA[
<message>
Funktio ei kelpaa.
 (0x1) - exit code 1 (0x1)
</message>
<stderr_txt>
wrapper: starting
13:55:07 (4768): unexpected tag in job.xml: zipfilename
[utopia1_26012_windows_x86_64__opencl_nvidia_100.zip]
  End-of-central-directory signature not found.  Either this file is not
  a zipfile, or it constitutes one disk of a multi-part archive.  In the
  latter case the central directory and zipfile comment will be found on
  the last disk(s) of this archive.
unzip:  cannot find zipfile directory in utopia1_26012_windows_x86_64__opencl_nvidia_100.zip,
        and cannot find utopia1_26012_windows_x86_64__opencl_nvidia_100.zip.zip, period.
boinc_unzip() error: 9

</stderr_txt>
]]>
15) Message boards : API : How to make the WrapperApp to work? (Message 48687)
Posted 19 Apr 2013 by HTH
Post:
No, but the wiki knows. This also may involve some heavy testing as the wrapper in it's current state may not know which GPU to use or can't tell the worker programm and this will fail. Maybe it's even impossible to run GPU apps through the wrapper as the wrapper can't make sure that the non-BOINC GPU application uses the correct ressource (if there is more than one GPU present).


Thanks for the tips. I'm working on it.


On a sidenote: Do have a specific concept (project) in mind or do you just want to optimize your own bitcoin mining operation? I wouldn't connect my computer to a bitcoin project if someone else is getting the bitcoins. And I also think it's a waste of resources because the exchange rate is not stable enough to know if the computer cycles used to generate a bitcoin are worth something in the future. I could investigate my unused cycles in research projects that I find more promising in producing actual results. But this is clearly a philosophical discussion.


Yes, I have a specific concept in my mind. The bitcoins will go 100% to science organizations. Also, the volatility of bitcoins is more a bless than a sin, in my opinion. If you have 1000 US dollars worth of bitcoins, it can skyrocket to 3000 US dollars or maybe to 10,000 US dollars in no time (even if the amount of bitcoins collected stays the same). Has funding ever been so exciting?

Actually, I think donating CPU/GPU power to mine bitcoins for science can be more useful than donating it to simulations. Also, it's not more expensive to mine bitcoins with GPU than use GPU to find extra-terrestrial intelligence. In either case, I won't get any money (BOINC projects don't give money to users), but I have to pay exact the same power bill.

Also, without funding, projects will die away. What do we simulate after that?
16) Message boards : API : How to make the WrapperApp to work? (Message 48683)
Posted 19 Apr 2013 by HTH
Post:
If you want to use the GPU you should create a GPU application or else your application will fail because another app is already scheduled to run on the GPU.


Any ideas how to use GPU apps with Wrapper?
17) Message boards : API : How to make the WrapperApp to work? (Message 48681)
Posted 19 Apr 2013 by HTH
Post:
Now I got this!

19.4.2013 10:19:09 | test | Sending scheduler request: To fetch work.
19.4.2013 10:19:09 | test | Requesting new tasks for CPU
19.4.2013 10:19:10 | test | Scheduler request completed: got 0 new tasks
19.4.2013 10:19:10 | test | Viesti palvelimelta: An GPU is required to run tasks for this project
19.4.2013 10:19:10 | test | No tasks sent
19.4.2013 10:19:10 | test | No tasks are available for Utopia Project 1
19.4.2013 10:19:10 | test | Project has no tasks available
19.4.2013 10:19:44 | test | update requested by user
19.4.2013 10:19:46 | test | Sending scheduler request: Requested by user.
19.4.2013 10:19:46 | test | Not requesting tasks: don't need
19.4.2013 10:19:47 | test | Scheduler request completed

How does BOINC Manager know that my application needs a GPU? Why doesn't it download the workunit then? I have a GPU with CUDA and OpenGL supports...
18) Message boards : API : How to make the WrapperApp to work? (Message 48680)
Posted 19 Apr 2013 by HTH
Post:
/home/boincadm/projects/test/templates/utopia1_out
---
<file_info>
    <name><OUTFILE_0/></name>
    <generated_locally/>
    <upload_when_present/>
    <max_nbytes>5000000</max_nbytes>
    <url><UPLOAD_URL/></url>
</file_info>
<result>
    <file_ref>
        <file_name><OUTFILE_0/></file_name>
        <open_name>phoenix.log</open_name>
        <copy_file/>
    </file_ref>
</result>

---

/home/boincadm/projects/test/templates/utopia1_in
----
<file_info>
  <number>0</number>
</file_info>
<workunit>
  <file_ref>
    <file_number>0</file_number>
    <open_name>phoenix.cfg</open_name>
    <copy_file/>
  </file_ref>
  <rsc_fpops_bound>1e12</rsc_fpops_bound>
  <rsc_fpops_est>1e14</rsc_fpops_est>
</workunit>

---

/home/boincadm/projects/test/apps/utopia1/26011/windows_x86_64/phoenix_job_1.11.xml
----
<job_desc>
  <task>
    <application>phoenix.exe</application>
  </task>
  <unzip_input>
    <zipfilename>utopia1_26011_windows_x86_64.zip</zipfilename>
  </unzip_input>
</job_desc>

---
19) Message boards : API : How to make the WrapperApp to work? (Message 48674)
Posted 18 Apr 2013 by HTH
Post:
Can I include subdirectories in the app folder without putting them inside a zip file?

Should I include them (the subdirectories and all the non-binary files) in the version.xml file?
20) Message boards : API : How to make the WrapperApp to work? (Message 48671)
Posted 18 Apr 2013 by HTH
Post:

--app_name worker should be --app_name utopia1
--wu_name worker_nodelete should be --wu_name utopia1_test1 (the nodelete tells the server to keep the input files in case you want to generate more work from them. You should also keep the name unique.
You may have to specify your template files too or rename them to end with .xml (depends on what server version you are using)
input should be a space separated list of input files (Which you somehow don't have) utopia1.zip is not an input file as you put it into the apps directory and it is bundled with the application version.

This will generate 1 Job with 1 Task (I hope) that is distributed to 1 host. If you want another just increment the wu_name to utopia1_test1 or change your input template parameters.


Thank you!

Is this some kind of bitcoin miner? It is a bit strange to run a program without commandline arguments or input files on more than one computer as the result should be the same on all of them.


Yes, it is a bitcoin miner. Okay. Now I have an input file for it. I decided to use phoenix.cfg as an input file. This is the command I use to make work:
boincadm@debian6:~/projects/test$ ./bin/create_work --appname utopia1 --wu_name wu_utopia1_01 --wu_template templates/utopia1_in --result_template templates/utopia1_out --min_quorum 1 --target_nresults 1 phoenix.cfg


I still have some problems, though.

XML doc in
<file_info>
    <name>wu_utopia1_03_0_0</name>
    <generated_locally/>
    <upload_when_present/>
    <max_nbytes>5000000</max_nbytes>
    <url>http://192.168.1.119/test_cgi/file_upload_handler</url>
</file_info>
<result>
    <file_ref>
        <file_name>wu_utopia1_03_0_0</file_name>
        <open_name>phoenix.log</open_name>
        <copy_file/>
    </file_ref>
</result>


XML doc out
<file_info><name>wu_utopia1_03_0_0</name>
    <nbytes>49.000000</nbytes>
    <max_nbytes>5000000.000000</max_nbytes>
    <md5_cksum>de180a83d17c8e6c8e750c6b3ae3b6be</md5_cksum>
    <upload_url>http://192.168.1.119/test_cgi/file_upload_handler</upload_url></file_info>


stderr out
<core_client_version>7.0.46</core_client_version>
<![CDATA[
<message>
à]& - exit code 195 (0xc3)
</message>
<stderr_txt>
wrapper: starting
16:33:28 (3724): unexpected tag in job.xml: zipfilename
16:33:28 (3724): wrapper: running ../../projects/192.168.1.119_test/phoenix.exe ()

[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]
[04/18/2013 16:33:28] Welcome to Phoenix v2.0.0     
[0 Khash/s] [0 Accepted] [0 Rejected] [DISCONNECTED]Traceback (most recent call last):
  File "phoenix.py", line 6, in <module>
  File "phoenix2\__init__.pyo", line 51, in main
  File "phoenix2\core\PhoenixCore.pyo", line 90, in start
  File "phoenix2\core\PhoenixCore.pyo", line 144, in discoverPlugins
WindowsError: [Error 3] M&#228;&#228;ritetty&#228; polkua ei l&#246;ydy: 'C:\\ProgramData\\BOINC\\projects\\192.168.1.119_test\\plugins/*.*'

                                                      app exit status: 0xff
16:33:29 (3724): called boinc_finish

</stderr_txt>
]]>


I think BOINC doesn't know how to unzip my zip file correctly. My zip files has some subdirectories and I didn't find them in the slot directory...


Next 20

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.