wiki:MacBuild

Version 18 (modified by charlief, 16 years ago) (diff)

--

Building BOINC Clients and Applications on Macintosh OS X

Last updated 12/6/07

This document applies to BOINC version 6.1.0 and later. It has instructions for building BOINC for Macintosh OS X, plus information for building science project applications to run under BOINC on Macintosh OS X.

Note: the information in this document changes from time to time for different versions of BOINC. For any version of BOINC source files, the corresponding version of this document can be found in the source tree at:

boinc/mac_build/HowToBuildBOINC_XCode.rtf

Contents of this document:

  1. Building BOINC Clients and Applications on Macintosh OS X
    1. Important requirements for building BOINC software for the Mac
    2. Building BOINC libraries to link with project applications
    3. Building BOINC Manager with embedded Core Client plus libraries libboinc.a and libboinc_graphics_api.a
    4. Building BOINC Manager Installer
    5. Debugging and BOINC security
    6. Building project applications
      1. Upgrading applications for Macs with Intel processors
      2. Upgrading applications for version 6 graphics
      3. Adding a Finder icon to your application

Important requirements for building BOINC software for the Mac

BOINC version 6.1.0 supports only Mac OS X 10.3.9 and later; support for OS 10.3.0 through 10.3.8 has been discontinued. This allows us to build the BOINC Client and Manager using only GCC 4.0, which offers a number of advantages.

BOINC version 6.1.0 Client and libraries include support for the x86_64 (64-bit Intel) architecture.

All BOINC software for Power PC Macs must be built using MacOS10.3.9 SDK to assure backward compatibility with OS 10.3.9. All 32-bit BOINC software for Intel Macs must be built using GCC 4.0 and MacOS10.4.u SDK to allow cross-compiling. All 64-bit BOINC software for Intel Macs must be built using GCC 4.0 and MacOS10.5 SDK.

The above requirements apply not only BOINC itself, but also the WxWidgets?, JPEG and cURL libraries, as well as all project applications. The BOINC Client does not use WxWidgets? or JPEG, so only the cURL library must be built for the x86_64 architecture.

Be sure to follow the directions in this document to ensure that these requirements are met.

Building BOINC now requires XCode Tools version 2.4.1 or later; XCode 3.0 or later is recommended.

Source files are now archived using Subversion. You can download svnX, a free GUI application for running Subversion from either http://www.apple.com/downloads/macosx/development_tools/svnx.html or http://www.lachoseinteractive.net/en/community/subversion/svnx/.

You also need to install Subversion itself. One place to get it is: http://www.codingmonkeys.de/mbo/

Building BOINC libraries to link with project applications

BOINC version 6.1.0 supports only Mac OS X 10.3.9 and later; support for OS 10.3.0 through 10.3.8 has been discontinued. This allows us to build the BOINC Client and Manager using only GCC 4.0. However, to ensure that science projects are compatible with older versions of BOINC running under OS 10.3.0 through 10.3.8, the PowerPC builds of the libraries are still built using GCC 3.3.

Beware of using the wrong compiler! Apple's release notes for GCC 4.0 say:

If your application must support versions of Mac OS X prior to 10.3.9, you must not use the GCC 4.0 compiler. Instead, build your project using the GCC 3.3 compiler.

Elsewhere on Apple's web site is the warning:

Do not link C++ modules compiled with one of these compilers against modules compiled with the other. Even if the modules appear to link correctly, C++ ABI differences may still cause problems that will not manifest themselves until run time.

If you are building a project application to be run by BOINC, you only need to build the BOINC libraries libboinc_api.a, libboinc.a, and (if you want graphics) libboinc_graphics_api. or libboinc_graphics2.a. (libboinc_graphics2.a is used for version 6 graphics, which is the method recommended for all applications.) There are two ways to do this:

  1. Use the BOINC autoconf / automake scripts to build these libraries and the jpeg and curl libraries on which they depend. You must do all of this twice: once on a PowerPC Mac running OS 10.3.x (do NOT use OS 10.4), and once on an Intel Mac running OS 10.4.x.

(If you wish, you can combine separate Intel and PowerPC builds in a single Universal Binary mach-O file using the command-line utility lipo. For details on lipo, type 'man lipo' in Terminal; it is available on all Macs running OS10.4.x.)

At the time this is written, the BOINC autoconf / automake scripts do not build 64-bit binaries.

(2) Use scripts setupForBOINC.sh and BuildMacBOINC.sh. You do this once on any Macintosh (PowerPC or Intel) running either OS 10.4.x and XCode 2.4.1, or OS 10.5.x and XCode 3.0 (or later) installed. This will produce Universal Binaries of all the libraries. These can then be linked with PowerPC, 32-bit Intel and 64-bit Intel Mac applications.

This document gives instructions only for the second method.

After building the libraries as Universal Binaries using the second method, you may still want to build your actual application separately on the two architectures: on a PowerPC Mac running OS 10.3.x (do NOT use OS 10.4), and also on an Intel Mac running OS 10.4.x. To build for the x86_64 architecture, use a Mac running either OS 10.4 or OS 10.5 and specify the -arch x86_64 option to the compiler and linker.

If you prefer, you can cross-compile on one Mac running OS 10.4.x or OS 10.5.x. Look at the scripts buildcurl.sh and buildjpeg.sh for examples of environment settings which allow you to do this.

Building BOINC Manager with embedded Core Client plus libraries libboinc.a and libboinc_graphics_api.a

BOINC depends on three third-party libraries: wxMac-2.6.3, curl-7.17.1, and jpeg-6b. (We have reverted to using wxMac-2.6.3 because we have found several bugs in later versions of wxMac.) You can obtain these from the following URLs:

wxMac-2.6.3 (needed only if you are building the BOINC Manager):

http://www.wxwidgets.org

http://prdownloads.sourceforge.net/wxwindows/wxMac-2.6.3.tar.gz

http://downloads.sourceforge.net/wxwindows/wxMac-2.6.3.tar.bz2

curl-7.17.1:

http://curl.haxx.se

http://curl.haxx.se/download/curl-7.17.1.tar.gz

jpeg-6b (needed only if you are building the BOINC libboinc_graphics_api.a library):

http://www.ijg.org

ftp://ftp.uu.net/graphics/jpeg/jpegsrc.v6b.tar.gz

XCode 2.4.1 installs autoconf 2.59 and automake 1.6.3. XCode 3.0 installs autoconf 2.61 and automake 1.10. To determine the version number, type 'autoconf --version' or 'automake --version'. Building curl-7.17.1 require autoconf 2.59 and automake 1.9.3 or later.

Upgrades for autoconf and automake are available from www.gnu.org:

http://ftp.gnu.org/gnu/autoconf/autoconf-2.61.tar.gz

http://ftp.gnu.org/gnu/automake/automake-1.10.tar.gz

XCode installed these utilities in the /usr/bin/ directory, but the upgrades by default will install in /usr/local/bin/. If you install there, you must also set your PATH environment variable to include that location. The scripts referenced below do this automatically.

As stated above, all BOINC software for Power PC Macs must be built using MacOS10.3.9 SDK and (for libraries) GCC 3.3 to assure backward compatibility with OS 10.3. All 32-bit BOINC software for Intel Macs must be built using GCC 4.0 and MacOS10.4.u SDK to allow cross-compiling. And all 64-bit BOINC software for Intel Macs must be built using GCC 4.0 and MacOS10.5 SDK.

These are not done by either the XCode projects which come with wxMac-2.6.3, nor the AutoMake scripts supplied with wxMac-2.6.3, curl-7.17.1, or jpeg-6b. So be sure to use our special scripts to build these packages.

Building BOINC and the library packages on which it depends requires OS 10.4.4 and XCode 2.4.1 (or greater). It may be possible to use XCode 2.3 and/or versions of OS X earlier than 10.4.4, but this has not been tested by the authors.

  1. Create a parent directory within which to work. In this description , we will call it BOINC_dev, but you can name it anything you wish.
  2. Put the following 3 directories inside the BOINC_dev folder (omit any you don't need):
    curl-7.17.1
    jpeg-6b
    wxMac-2.6.3
    
    Important: do not change the names of any of these 3 directories.
  3. Get the BOINC source tree from SVN, and put it in the same BOINC_dev folder. To do this, type the following in Terminal:
    cd {path}/BOINC_dev/
    svn co http://boinc.berkeley.edu/svn/trunk/boinc
    
    (You may change the name of the boinc directory to anything you wish.)

The command above retrieves the source code from the HEAD or development branch of the SVN repository. See more information on getting the BOINC source code?.

  1. Run the script to build the curl, jpeg and wxMac libraries as follows:
    cd {path}/BOINC_dev/boinc/mac_build/
    source setupForBoinc.sh -clean
    
    If you don't wish to force a full rebuild of everything, omit the -clean argument.

Note: this script builds curl first, followed by jpeg and finally wxMac. If you haven't downloaded wxMac because you aren't building the BOINC Manager, the script will build curl and jpeg. Likewise, if you downloaded only curl because you need neither graphics nor the BOINC Manager, the script will build curl before quitting.

  1. Build BOINC as follows:
    cd {path}/BOINC_dev/boinc/mac_build/
    source BuildMacBOINC.sh
    

The complete syntax for this script is

source BuildMacBOINC.sh [-dev] [-noclean] [-no64bit] [-all] [-lib] [-client] [-help]

The options for BuildMacBOINC.sh are:

-dev
build the development (debug) version (native architecture only). default is deployment (release) version (universal binaries: ppc and i386).
-noclean
don't do a 'clean' of each target before building. default is to clean all first.
-no64bit
build 32-bit binaries only, no x86_64 architecture.

The following arguments determine which targets to build

-all
build all targets (i.e. target 'Build_All' -- this is the default)
-lib
build the three libraries: libboinc_api.a, libboinc_graphics_api.a, libboinc.a
-client
build two targets: BOINC client and command-line utility boinc_cmd? (also builds libboinc.a, since boinc_cmd requires it.)

Both -lib and -client may be specified to build five targets (no BOINC Manager.)

Note: You may find three XCode projects in the BOINC_dev/boinc/mac_build/ directory:

  • boinc.pbproj is obsolete and should no longer be used.
  • wxMac-BOINC.xcodeproj was needed for building older versions of the wxMac library in conjunction with the older versions of the setupForBoinc.sh or buildWxMac.sh scripts. It is not used for BOINC 5.9.2 or later.
  • boinc.xcodeproj builds BOINC. It can be used either with the BuildMacBOINC.sh script or as a stand-alone project. It has two extra build configurations, i386-Deployment and ppc-Deployment, which can be used for testing only to build for just one architecture. The Development build configuration builds only the native architecture and is used for debugging. The Deployment build configuration builds a universal binary and is suitable for release builds.

Building BOINC Manager Installer

To build the Installer for the BOINC Manager, you must be logged in as an administrator. If you are building BOINC version number x.y.z, type the following in Terminal, then enter your administrator password when prompted by the script:

cd {path}/BOINC_dev/boinc/
source {path}/BOINC_dev/boinc/mac_installer/release_boinc.sh x y z

Substitute the 3 parts of the BOINC version number for x y and z in the above. For example, to build the installer for BOINC version 5.5.4, the command would be

source {path}/BOINC_dev/boinc/mac_installer/release_boinc.sh 5 5 4

This will create a directory 'BOINC_Installer/New_Release_5_5_4' in the BOINC_dev directory.

To build version 5.5.4 of the Grid Republic flavor of BOINC, you would type:

cd {path}/BOINC_dev/boinc/
source {path}/BOINC_dev/boinc/mac_installer/release_GridRepublic.sh 5 5 4

This will create a directory 'BOINC_Installer/New_Release_GR_5_5_4' in the BOINC_dev directory.

Debugging and BOINC security

Version 5.5.4 of BOINC Manager for the Macintosh introduced new, stricter security measures. For details, please see the file Readme.rtf and web pages Sandbox Design and Sandbox User.

The GDB debugger can't attach to applications which are running as a different user or group so it ignores the S_ISUID and S_ISGID permission bits when launching an application. To work around this, BOINC does not use the special boinc_master or boinc_project users or groups when run from XCode.

The Development build only of the BOINC Manager allows you to change the ownership and permission settings of the BOINC Data and executables by entering an administrator user name and password. This also streamlines the development cycle by avoiding the need to run the installer for every change.

To restore the standard ownerships and permissions, run the installer.

Building project applications

Upgrading applications for Macs with Intel processors

Apple converted all its lines of computers to Intel processors during 2006. The early Intel Macs used the Core Duo processor, which is a 32-bit CPU. Later Intel processors, including the Core 2 Duo, can run both 32-bit and 64-bit applications. However, BOINC will run in 64-bit mode only under OS 10.5 and later.

All current releases of BOINC include "universal binary" builds for the Macintosh of BOINC Manager, command-line BOINC client and the boinc_cmd command-line tool. (Universal binaries contain both PowerPC and Intel executables in one file; the Macintosh OS automatically selects the appropriate one for that computer.) Beginning with version 6.1, the BOINC Client and libraries also include the 64-bit Intel architecture as part of the universal binaries.

The advantage of 'universal binaries' is that you only need to have one copy of the application, and it will run on either PowerPC or Intel Macs, so users don't need to choose between two options. Since BOINC participants manually download BOINC from the web site, we will be providing BOINC in 'universal binary' form.

However, participants do not manually download project applications; this is done automatically by BOINC. So there would be no advantage to combining the Intel and PowerPC versions in a single 'universal binary' file, but doing so would double the size of the download.

Starting with BOINC 5.9.7, the Intel BOINC Client accepts powerpc-apple-darwin applications if no i686-apple-darwin is available. The OS will run it in compatibility mode, emulating a PowerPC. (Apple calls this compatibility mode Rosetta, which of course has nothing to do with the Rosetta BOINC project.)

The x86_64 BOINC Client requests x86_64-apple-darwin applications from BOINC servers as its first choice, i686-apple-darwin as a second choice, and finally powerpc-apple-darwin if no Intel applications are available.

However, older Intel Mac clients will not get any work unless the server offers i686-apple-darwin applications.

As a temporary measure, projects can set their servers to deliver a copy of their current PowerPC application (renamed for the new platform) under the i686-apple-darwin platform for older BOINC Clients.

If you do this, be sure to give your native Intel application a higher version number when you do release it, so that clients will download it.

However, running a PowerPC application in compatibility mode has two significant drawbacks:

  • Screensaver graphics do not work.
  • Since it is running under emulation, your application will run at reduced efficiency. But the benchmarks are based on running native Intel applications. This may cause scheduler problems, such as uncompleted deadlines and inadequate credit for participants.

So it is important to make a native Intel application available as soon as possible. It is very easy to add a new platform to your server with the xadd utility.

BOINC supports all PowerPC Macs running OS 10.3.0 or later, and all Intel Macs. (The Intel Macs themselves require OS 10.4.4 or later.)

The easiest way to build your application for these two platforms is to build each one on its native platform. In other words, do your powerpc-apple-darwin build on a PowerPC Mac running OS 10.3.9, and your i686-apple-darwin build on an Intel Mac.

But Apple provides the tools to allow you to cross-compile your application on any Mac (PowerPC or Intel) running OS 10.4 or later. Here is how:

All BOINC project applications for Power PC Macs must be built using GCC 3.3 and MacOS10.3.9 SDK to assure backward compatibility with OS 10.3. If building a PowerPC application on an Intel Mac, you must also specify "-arch ppc" in the compiler and linker flags.

All 32-bit BOINC software for Intel Macs must be built using GCC 4.0 and MacOS10.4.u SDK to allow cross-compiling. If building an Intel application on a PowerPC Mac, you must also specify "-arch i386" in the compiler and linker flags.

All 64-bit BOINC software for Intel Macs must be built using GCC 4.0 and MacOS10.5 SDK. To build for the x86_64 architecture, use a Mac running either OS 10.4 or OS 10.5 and specify the -arch x86_64 option to the compiler and linker.

If you prefer, you can cross-compile on one Mac running OS 10.4.x or OS 10.5.x. You can find examples of how to do this for two different kinds of configure / make scripts in the HEAD branch of the BOINC SVN tree at boinc/mac_build/buildcurl.sh and boinc/mac_build/buildjpeg.sh.

The lipo utility is used at the end of each of these scripts to combine the two binaries into a single "Universal Binary" file. You won't need to do that with you project applications, since you will be distributing them separately under the two platforms. But if you prefer, you can create a Universal Binary and distribute the same file for both i686-apple-darwin and powerpc-apple-darwin platforms (and also the x86_64-apple-darwin platform if you wish).

Note that the BOINC libraries (and any third-party libraries) which you link with your applications must be built with the same configuration as the application itself. Follow the instructions earlier in this document to build the needed libraries.

Additional information on building Unix applications universal can be found here: http://developer.apple.com/documentation/Porting/Conceptual/PortingUnix/compiling/chapter_4_section_3.html

and here: http://developer.apple.com/documentation/MacOSX/Conceptual/universal_binary/universal_binary_compiling/chapter_2_section_7.html

For information on making your code work with GCC 4: http://developer.apple.com/releasenotes/DeveloperTools/GCC40PortingReleaseNotes/index.html

Upgrading applications for version 6 graphics

One of the major changes in BOINC for version 6 is that applications are now expected to generate graphics in a separate executable. The graphics application typically communicates with the worker application using shared memory.

For additional information, please see: http://boinc.berkeley.edu/trac/milestone/6.0 and http://boinc.berkeley.edu/trac/wiki/GraphicsApi

Adding a Finder icon to your application

There is an optional API setMacIcon() in the libboinc_api.a library. This allows science applications to display an application icon in the Dock and in the Finder. (The icon does not appear in the Dock until the application displays graphics.) To implement this, do the following:

  • Use '/Developer/Applications?/utilities/Icon Composer.app' to create a xxx.icns file. (Use any name you wish instead of xxx.)
  • Convert the xxx.icns file to an app_icon.h file as follows: in Terminal, run:
    {path}/MakeAppIcon_h {source_file_path}/xxx.icns {dest_file_path}/app_icon.h
    
    (The !MakeAppIcon_h command-line utility is built by the Mac boinc XCode project in the 'boinc/mac_build/build/' directory.) Add the app_icon.h file to your science application's project.
  • In the science application's main(), add
    #include "app_icon.h" 
    
    and call:
    setMacIcon(argv[0], MacAppIconData, sizeof(MacAppIconData));
    
  • The science application must link with Carbon.framework to use setMacIcon().