Does BOINC have a maximum limit on how much disk space it can use?

Author	Message
jjch Send message Joined: 12 Jun 20 Posts: 3	Message 99261 - Posted: 12 Jun 2020, 5:08:48 UTC BOINC team, Lately I have noted that one of my large servers has been running out of disk space that BOINC will use even though I do not have any restrictions set. While Rosetta is a large disk space user it appears that BOINC has a maximum limit of about 100GB that it can use even though the available disk space is greater. The current free disk space is 177GB but BOINC is maxed out at 99GB. Is there another way to increase the actual disk space BOINC will use up to the maximum space available on a disk? Additional details: BOINC version 7.16.7 BOINC disk D: drive 279GB CPU's Xeon E7-4890 v2 2.80GHz - 15 cores x 4 sockets w/hyper-threading total 120 processors Memory 256GB Windows 2012 R2 DC GPUGRID, Rosetta, WCG Sample event log: 6/11/2020 9:03:42 PM \| \| Starting BOINC client version 7.16.7 for windows_x86_64 6/11/2020 9:03:42 PM \| \| Libraries: libcurl/7.47.1 OpenSSL/1.0.2s zlib/1.2.8 6/11/2020 9:03:42 PM \| \| Data directory: D:\Program Data\BOINC 6/11/2020 9:03:42 PM \| \| Running under account Administrator 6/11/2020 9:03:48 PM \| \| CUDA: NVIDIA GPU 0: TITAN Xp (driver version 442.59, CUDA version 10.2, compute capability 6.1, 4096MB, 3022MB available, 12150 GFLOPS peak) 6/11/2020 9:03:48 PM \| \| CUDA: NVIDIA GPU 1: TITAN Xp (driver version 442.59, CUDA version 10.2, compute capability 6.1, 4096MB, 3022MB available, 12150 GFLOPS peak) 6/11/2020 9:03:48 PM \| \| OpenCL: NVIDIA GPU 0: TITAN Xp (driver version 442.59, device version OpenCL 1.2 CUDA, 12288MB, 3022MB available, 12150 GFLOPS peak) 6/11/2020 9:03:48 PM \| \| OpenCL: NVIDIA GPU 1: TITAN Xp (driver version 442.59, device version OpenCL 1.2 CUDA, 12288MB, 3022MB available, 12150 GFLOPS peak) 6/11/2020 9:03:48 PM \| \| Windows processor group 0: 60 processors 6/11/2020 9:03:48 PM \| \| Windows processor group 1: 60 processors 6/11/2020 9:03:48 PM \| \| Host name: DL580G8-01 6/11/2020 9:03:48 PM \| \| Processor: 120 GenuineIntel Intel(R) Xeon(R) CPU E7-4890 v2 @ 2.80GHz [Family 6 Model 62 Stepping 4] 6/11/2020 9:03:48 PM \| \| Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss htt tm pni ssse3 cx16 sse4_1 sse4_2 popcnt aes f16c rdrandsyscall nx lm avx vmx smx tm2 dca pbe fsgsbase smep 6/11/2020 9:03:48 PM \| \| OS: Microsoft Windows Server 2012 R2: Datacenter x64 Edition, (06.03.9600.00) 6/11/2020 9:03:48 PM \| \| Memory: 255.90 GB physical, 293.90 GB virtual 6/11/2020 9:03:48 PM \| \| Disk: 279.37 GB total, 177.61 GB free 6/11/2020 9:03:48 PM \| \| Local time is UTC -7 hours 6/11/2020 9:03:48 PM \| \| No WSL found. 6/11/2020 9:03:48 PM \| Einstein@Home \| Found app_config.xml 6/11/2020 9:03:48 PM \| Einstein@Home \| Your app_config.xml file refers to an unknown application 'hsgamma_FGRPB1G'. Known applications: None 6/11/2020 9:03:48 PM \| Milkyway@Home \| Found app_config.xml 6/11/2020 9:03:48 PM \| Milkyway@Home \| Your app_config.xml file refers to an unknown application 'milkyway'. Known applications: None 6/11/2020 9:03:48 PM \| \| Config: GUI RPC allowed from any host 6/11/2020 9:03:48 PM \| \| Config: use all coprocessors 6/11/2020 9:03:48 PM \| World Community Grid \| General prefs: from World Community Grid (last modified 26-Nov-2017 22:57:00) 6/11/2020 9:03:48 PM \| World Community Grid \| Host location: none 6/11/2020 9:03:48 PM \| World Community Grid \| General prefs: using your defaults 6/11/2020 9:03:48 PM \| \| Reading preferences override file 6/11/2020 9:03:48 PM \| \| Preferences: 6/11/2020 9:03:48 PM \| \| max memory usage when active: 209633.19 MB 6/11/2020 9:03:48 PM \| \| max memory usage when idle: 235837.34 MB 6/11/2020 9:03:53 PM \| \| max disk usage: 276.88 GB 6/11/2020 9:03:53 PM \| \| (to change preferences, visit a project web site or select Preferences in the Manager) 6/11/2020 9:03:53 PM \| \| Setting up project and slot directories 6/11/2020 9:03:53 PM \| \| Checking active tasks 6/11/2020 9:03:53 PM \| \| Using account manager BOINCstatsBAM! 6/11/2020 9:03:53 PM \| Einstein@Home \| URL http://einstein.phys.uwm.edu/; Computer ID 12537465; resource share 0 6/11/2020 9:03:53 PM \| Einstein@Home \| Your settings do not allow fetching tasks for CPU. To fix this, you can change Project Preferences on the project's web site. 6/11/2020 9:03:53 PM \| GPUGRID \| URL https://www.gpugrid.net/; Computer ID 549773; resource share 10000 6/11/2020 9:03:53 PM \| Milkyway@Home \| URL http://milkyway.cs.rpi.edu/milkyway/; Computer ID 733728; resource share 100 6/11/2020 9:03:53 PM \| Milkyway@Home \| Your settings do not allow fetching tasks for CPU. To fix this, you can change Project Preferences on the project's web site. 6/11/2020 9:03:53 PM \| Rosetta@home \| URL https://boinc.bakerlab.org/rosetta/; Computer ID 3216841; resource share 10000 6/11/2020 9:03:53 PM \| World Community Grid \| URL http://www.worldcommunitygrid.org/; Computer ID 3974138; resource share 0 6/11/2020 9:03:53 PM \| \| Setting up GUI RPC socket 6/11/2020 9:03:53 PM \| \| Checking presence of 471 project files 6/11/2020 9:09:43 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:09:43 PM \| Rosetta@home \| Message from server: Rosetta needs 970.59MB more disk space. You currently have 746.03 MB available and it needs 1716.61 MB. 6/11/2020 9:09:43 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:09:46 PM \| \| Contacting account manager at https://bam.boincstats.com/ 6/11/2020 9:09:47 PM \| \| Account manager: BAM! User: 160210, jjch 6/11/2020 9:09:47 PM \| \| Account manager: BAM! Host: 540590 6/11/2020 9:09:47 PM \| \| Account manager: Number of BAM! connections for this host: 73988 6/11/2020 9:09:47 PM \| \| Account manager contact succeeded 6/11/2020 9:09:55 PM \| GPUGRID \| No tasks sent 6/11/2020 9:09:55 PM \| GPUGRID \| No tasks are available for Long runs (8-12 hours on fastest card) 6/11/2020 9:09:55 PM \| GPUGRID \| No tasks are available for Anaconda Python 3 Environment 6/11/2020 9:09:55 PM \| GPUGRID \| Message from server: New version of ACEMD needs 3070.41MB more disk space. You currently have 744.28 MB available and it needs 3814.70 MB. 6/11/2020 9:09:55 PM \| GPUGRID \| Project requested delay of 31 seconds 6/11/2020 9:10:07 PM \| World Community Grid \| Project requested delay of 121 seconds 6/11/2020 9:12:27 PM \| World Community Grid \| Project requested delay of 121 seconds 6/11/2020 9:13:32 PM \| World Community Grid \| General prefs: from World Community Grid (last modified 26-Nov-2017 22:57:00) 6/11/2020 9:13:32 PM \| World Community Grid \| Host location: none 6/11/2020 9:13:32 PM \| World Community Grid \| General prefs: using your defaults 6/11/2020 9:13:32 PM \| \| Reading preferences override file 6/11/2020 9:13:32 PM \| \| Preferences: 6/11/2020 9:13:32 PM \| \| max memory usage when active: 209633.19 MB 6/11/2020 9:13:32 PM \| \| max memory usage when idle: 235837.34 MB 6/11/2020 9:13:37 PM \| \| max disk usage: 276.88 GB 6/11/2020 9:13:37 PM \| \| (to change preferences, visit a project web site or select Preferences in the Manager) 6/11/2020 9:14:37 PM \| World Community Grid \| General prefs: from World Community Grid (last modified 26-Nov-2017 22:57:00) 6/11/2020 9:14:37 PM \| World Community Grid \| Host location: none 6/11/2020 9:14:37 PM \| World Community Grid \| General prefs: using your defaults 6/11/2020 9:14:37 PM \| \| Reading preferences override file 6/11/2020 9:14:37 PM \| \| Preferences: 6/11/2020 9:14:37 PM \| \| max memory usage when active: 209633.19 MB 6/11/2020 9:14:37 PM \| \| max memory usage when idle: 235837.34 MB 6/11/2020 9:14:42 PM \| \| max disk usage: 251.43 GB 6/11/2020 9:14:42 PM \| \| (to change preferences, visit a project web site or select Preferences in the Manager) 6/11/2020 9:14:45 PM \| World Community Grid \| Project requested delay of 121 seconds 6/11/2020 9:15:31 PM \| GPUGRID \| update requested by user 6/11/2020 9:15:39 PM \| GPUGRID \| No tasks sent 6/11/2020 9:15:39 PM \| GPUGRID \| No tasks are available for Long runs (8-12 hours on fastest card) 6/11/2020 9:15:39 PM \| GPUGRID \| No tasks are available for Anaconda Python 3 Environment 6/11/2020 9:15:39 PM \| GPUGRID \| Message from server: New version of ACEMD needs 3074.33MB more disk space. You currently have 740.37 MB available and it needs 3814.70 MB. 6/11/2020 9:15:39 PM \| GPUGRID \| Project requested delay of 31 seconds 6/11/2020 9:16:20 PM \| Rosetta@home \| update requested by user 6/11/2020 9:16:29 PM \| GPUGRID \| No tasks sent 6/11/2020 9:16:29 PM \| GPUGRID \| No tasks are available for Long runs (8-12 hours on fastest card) 6/11/2020 9:16:29 PM \| GPUGRID \| No tasks are available for Anaconda Python 3 Environment 6/11/2020 9:16:29 PM \| GPUGRID \| Message from server: New version of ACEMD needs 3073.61MB more disk space. You currently have 741.09 MB available and it needs 3814.70 MB. 6/11/2020 9:16:29 PM \| GPUGRID \| Project requested delay of 31 seconds 6/11/2020 9:16:40 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:16:40 PM \| Rosetta@home \| Message from server: Rosetta needs 976.69MB more disk space. You currently have 739.93 MB available and it needs 1716.61 MB. 6/11/2020 9:16:40 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:17:28 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:17:28 PM \| Rosetta@home \| Message from server: Rosetta needs 979.93MB more disk space. You currently have 736.69 MB available and it needs 1716.61 MB. 6/11/2020 9:17:28 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:20:03 PM \| World Community Grid \| Project requested delay of 121 seconds 6/11/2020 9:20:16 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:20:16 PM \| Rosetta@home \| Message from server: Rosetta needs 11.37MB more disk space. You currently have 1705.25 MB available and it needs 1716.61 MB. 6/11/2020 9:20:16 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:24:25 PM \| GPUGRID \| No tasks sent 6/11/2020 9:24:25 PM \| GPUGRID \| No tasks are available for Long runs (8-12 hours on fastest card) 6/11/2020 9:24:25 PM \| GPUGRID \| No tasks are available for Anaconda Python 3 Environment 6/11/2020 9:24:25 PM \| GPUGRID \| Message from server: New version of ACEMD needs 2108.20MB more disk space. You currently have 1706.50 MB available and it needs 3814.70 MB. 6/11/2020 9:24:25 PM \| GPUGRID \| Project requested delay of 31 seconds 6/11/2020 9:24:37 PM \| World Community Grid \| Project requested delay of 121 seconds 6/11/2020 9:26:08 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:26:08 PM \| Rosetta@home \| Message from server: Rosetta needs 5.80MB more disk space. You currently have 1710.81 MB available and it needs 1716.61 MB. 6/11/2020 9:26:08 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:26:08 PM \| Rosetta@home \| General prefs: from Rosetta@home (last modified 11-Jun-2020 21:22:47) 6/11/2020 9:26:08 PM \| Rosetta@home \| Computer location: school 6/11/2020 9:26:08 PM \| Rosetta@home \| General prefs: no separate prefs for school; using your defaults 6/11/2020 9:26:08 PM \| \| Reading preferences override file 6/11/2020 9:26:08 PM \| \| Preferences: 6/11/2020 9:26:08 PM \| \| max memory usage when active: 209633.19 MB 6/11/2020 9:26:08 PM \| \| max memory usage when idle: 235837.34 MB 6/11/2020 9:26:14 PM \| \| max disk usage: 251.43 GB 6/11/2020 9:26:14 PM \| \| (to change preferences, visit a project web site or select Preferences in the Manager) 6/11/2020 9:28:55 PM \| GPUGRID \| No tasks sent 6/11/2020 9:28:55 PM \| GPUGRID \| No tasks are available for Long runs (8-12 hours on fastest card) 6/11/2020 9:28:55 PM \| GPUGRID \| No tasks are available for Anaconda Python 3 Environment 6/11/2020 9:28:55 PM \| GPUGRID \| Message from server: New version of ACEMD needs 2105.92MB more disk space. You currently have 1708.78 MB available and it needs 3814.70 MB. 6/11/2020 9:28:55 PM \| GPUGRID \| Project requested delay of 31 seconds 6/11/2020 9:31:06 PM \| World Community Grid \| Project requested delay of 121 seconds 6/11/2020 9:31:18 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:32:03 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:32:45 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:33:25 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:34:05 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:34:47 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:35:25 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:36:04 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:36:46 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:37:24 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:38:04 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:38:46 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:39:28 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:39:41 PM \| GPUGRID \| No tasks sent 6/11/2020 9:39:41 PM \| GPUGRID \| No tasks are available for Long runs (8-12 hours on fastest card) 6/11/2020 9:39:41 PM \| GPUGRID \| No tasks are available for Anaconda Python 3 Environment 6/11/2020 9:39:41 PM \| GPUGRID \| Message from server: New version of ACEMD needs 1243.04MB more disk space. You currently have 2571.66 MB available and it needs 3814.70 MB. 6/11/2020 9:39:41 PM \| GPUGRID \| Project requested delay of 31 seconds 6/11/2020 9:39:56 PM \| Rosetta@home \| General prefs: from Rosetta@home (last modified 11-Jun-2020 21:22:47) 6/11/2020 9:39:56 PM \| Rosetta@home \| Computer location: school 6/11/2020 9:39:56 PM \| Rosetta@home \| General prefs: no separate prefs for school; using your defaults 6/11/2020 9:39:56 PM \| \| Reading preferences override file 6/11/2020 9:39:56 PM \| \| Preferences: 6/11/2020 9:39:56 PM \| \| max memory usage when active: 209633.19 MB 6/11/2020 9:39:56 PM \| \| max memory usage when idle: 235837.34 MB 6/11/2020 9:40:02 PM \| \| max disk usage: 276.90 GB 6/11/2020 9:40:02 PM \| \| (to change preferences, visit a project web site or select Preferences in the Manager) 6/11/2020 9:40:10 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:40:23 PM \| GPUGRID \| No tasks sent 6/11/2020 9:40:23 PM \| GPUGRID \| No tasks are available for Long runs (8-12 hours on fastest card) 6/11/2020 9:40:23 PM \| GPUGRID \| No tasks are available for Anaconda Python 3 Environment 6/11/2020 9:40:23 PM \| GPUGRID \| Message from server: New version of ACEMD needs 1252.53MB more disk space. You currently have 2562.17 MB available and it needs 3814.70 MB. 6/11/2020 9:40:23 PM \| GPUGRID \| Project requested delay of 31 seconds 6/11/2020 9:40:54 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:41:36 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:42:16 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:43:01 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:43:01 PM \| Rosetta@home \| Message from server: Rosetta needs 57.70MB more disk space. You currently have 1658.92 MB available and it needs 1716.61 MB. 6/11/2020 9:43:01 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:47:26 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:47:26 PM \| Rosetta@home \| Message from server: Rosetta needs 161.46MB more disk space. You currently have 1555.15 MB available and it needs 1716.61 MB. 6/11/2020 9:47:26 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:51:13 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:51:13 PM \| Rosetta@home \| Message from server: Rosetta needs 231.74MB more disk space. You currently have 1484.88 MB available and it needs 1716.61 MB. 6/11/2020 9:51:13 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:52:24 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:52:24 PM \| Rosetta@home \| Message from server: Rosetta needs 117.07MB more disk space. You currently have 1599.55 MB available and it needs 1716.61 MB. 6/11/2020 9:52:24 PM \| Rosetta@home \| Project requested delay of 31 seconds 6/11/2020 9:53:45 PM \| Rosetta@home \| No tasks sent 6/11/2020 9:53:45 PM \| Rosetta@home \| Message from server: Rosetta needs 689.84MB more disk space. You currently have 1026.77 MB available and it needs 1716.61 MB. 6/11/2020 9:53:45 PM \| Rosetta@home \| Project requested delay of 31 seconds ID: 99261 ·

Jord Volunteer tester Help desk expert Send message Joined: 29 Aug 05 Posts: 15480	Message 99262 - Posted: 12 Jun 2020, 6:55:26 UTC - in response to Message 99261. Last modified: 12 Jun 2020, 6:55:51 UTC Couple of things: 6/11/2020 9:03:53 PM \| \| max disk usage: 276.88 GB This is the maximum you set it can use. 6/11/2020 9:09:43 PM \| Rosetta@home \| Message from server: Rosetta needs 970.59MB more disk space. You currently have 746.03 MB available and it needs 1716.61 MB. 6/11/2020 9:09:55 PM \| GPUGRID \| Message from server: New version of ACEMD needs 3070.41MB more disk space. You currently have 744.28 MB available and it needs 3814.70 MB. But your problem is different. 6/11/2020 9:14:42 PM \| \| max disk usage: 251.43 GB So then you changed preferences. 6/11/2020 9:40:02 PM \| \| max disk usage: 276.90 GB And again. None of that helped. However, the disk space preferences aren't just set by "Use no more than N GB", but also by "Leave at least N GB free" and more critically, "Use no more than N% of total". What are all those values set to? If in doubt, post the contents of your global_prefs_override.xml file. You can open the file with a default ASCII text editor. ID: 99262 ·

jjch Send message Joined: 12 Jun 20 Posts: 3	Message 99271 - Posted: 13 Jun 2020, 5:15:24 UTC - in response to Message 99262. As you noted I did make a temporary change to the maximum disk space and set it to 90% then removed the setting. The disk_max_used_gb is not selected/set to 0, disk_max_used_pct is not selected/set to 100, and the disk_min_free_gb is not selected/set to 0 Here are the current settings in the global_prefs_override file. <global_preferences> <run_on_batteries>0</run_on_batteries> <run_if_user_active>1</run_if_user_active> <run_gpu_if_user_active>1</run_gpu_if_user_active> <suspend_cpu_usage>0.000000</suspend_cpu_usage> <start_hour>0.000000</start_hour> <end_hour>0.000000</end_hour> <net_start_hour>0.000000</net_start_hour> <net_end_hour>0.000000</net_end_hour> <leave_apps_in_memory>0</leave_apps_in_memory> <confirm_before_connecting>1</confirm_before_connecting> <hangup_if_dialed>0</hangup_if_dialed> <dont_verify_images>0</dont_verify_images> <work_buf_min_days>0.100000</work_buf_min_days> <work_buf_additional_days>0.010000</work_buf_additional_days> <max_ncpus_pct>100.000000</max_ncpus_pct> <cpu_scheduling_period_minutes>180.000000</cpu_scheduling_period_minutes> <disk_interval>180.000000</disk_interval> <disk_max_used_gb>0.000000</disk_max_used_gb> <disk_max_used_pct>100.000000</disk_max_used_pct> <disk_min_free_gb>0.000000</disk_min_free_gb> <vm_max_used_pct>100.000000</vm_max_used_pct> <ram_max_used_busy_pct>80.000000</ram_max_used_busy_pct> <ram_max_used_idle_pct>90.000000</ram_max_used_idle_pct> <max_bytes_sec_up>0.000000</max_bytes_sec_up> <max_bytes_sec_down>0.000000</max_bytes_sec_down> <cpu_usage_limit>100.000000</cpu_usage_limit> <daily_xfer_limit_mb>0.000000</daily_xfer_limit_mb> <daily_xfer_period_days>0</daily_xfer_period_days> </global_preferences> The disk space and memory requirements for Rosetta have grown quite a bit over the last several months. While this system can run a large number of Rosetta and WCG tasks it is not allowing GPUGRID to download more work. JJCH ID: 99271 ·

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.