wiki:MacBuild

Version 9 (modified by Nicolas, 17 years ago) (diff)

Lots of cleanup; fixed typos, formatting, added some links...

Building BOINC Clients and Applications on Macintosh OS X

Last updated 7/21/07

This document applies to BOINC version 5.10.14 and later. It has instructions for building BOINC for Macintosh OS X, plus information for building science project applications to run under BOINC on Macintosh OS X.

Note: the information in this document changes from time to time for different versions of BOINC. For any version of BOINC source files, the corresponding version of this document can be found in the source tree at:

boinc/mac_build/HowToBuildBOINC_XCode.rtf

Contents of this document:

  1. Building BOINC Clients and Applications on Macintosh OS X
    1. Important requirements for building BOINC software for the Mac
    2. Building BOINC libraries to link with project applications
    3. Building BOINC Manager with embedded Core Client plus libraries libboinc.a and libboinc_graphics_api.a
    4. Building BOINC Manager Installer
    5. Debugging and BOINC security
    6. Building project applications
      1. Upgrading applications for Macs with Intel processors
      2. Adding a Finder icon to your application

Important requirements for building BOINC software for the Mac

All BOINC software for Power PC Macs must be built using GCC 3.3 and MacOS10.3.9 SDK to assure backward compatibility with OS 10.3. All BOINC software for Intel Macs must be built using GCC 4.0 and MacOS 10.4.u SDK to allow cross-compiling. This includes not only BOINC itself, but also the WxWidgets, JPEG and cURL libraries, as well as all project applications.

Beware of using the wrong compiler! Apple's release notes for GCC 4.0 say:

If your application must support versions of Mac OS X prior to 10.3.9, you must not use the GCC 4.0 compiler. Instead, build your project using the GCC 3.3 compiler.

Elsewhere on Apple's web site is the warning:

Do not link C++ modules compiled with one of these compilers against modules compiled with the other. Even if the modules appear to link correctly, C++ ABI differences may still cause problems that will not manifest themselves until run time.

Be sure to follow the directions in this document to ensure that these requirements are met.

Building BOINC now requires XCode Tools version 2.4.1 or later. (Version 2.3 may work; this has not been tested.)

Source files are now archived using Subversion. You can download svnX, a free GUI application for running Subversion from either http://www.apple.com/downloads/macosx/development_tools/svnx.html or http://www.lachoseinteractive.net/en/community/subversion/svnx/.

You also need to install Subversion itself. One place to get it is: http://www.codingmonkeys.de/mbo/

Building BOINC libraries to link with project applications

If you are building a project application to be run by BOINC, you only need to build the BOINC libraries libboinc_api.a, libboinc.a, and (if you want graphics) libboinc_graphics_api.a. There are two ways to do this:

  1. Use the BOINC autoconf / automake scripts to build these libraries and the jpeg and curl libraries on which they depend. You must do all of this twice: once on a PowerPC Mac running OS 10.3.x (do NOT use OS 10.4), and once on an Intel Mac running OS 10.4.x.

(If you wish, you can combine separate Intel and PowerPC builds in a single Universal Binary mach-O file using the command-line utility lipo. For details on lipo, type 'man lipo' in Terminal; it is available on all Macs running OS10.4.x.)

  1. Use scripts setupForBOINC.sh and BuildMacBOINC.sh. You do this once on any Macintosh (PowerPC or Intel) running OS 10.4.x and with XCode 2.4.1 (or later) installed. This will produce Universal Binaries of all the libraries. These can then be linked with both PowerPC applications and Mac Intel applications.

This document gives instructions only for the second method.

After building the libraries as Universal Binaries using the second method, you probably still want to build your actual application separately on the two architectures: on a PowerPC Mac running OS 10.3.x (do NOT use OS 10.4), and also on an Intel Mac running OS 10.4.x. Or you can look at the scripts buildcurl.sh and buildjpeg.sh for examples of environment settings which can cross-compile on one Mac running OS 10.4.x.

Building BOINC Manager with embedded Core Client plus libraries libboinc.a and libboinc_graphics_api.a

BOINC depends on three third-party libraries: wxMac-2.8.0, curl-7.16.4, and jpeg-6b. (We have reverted to using wxMac-2.8.0 because we have found several bugs in later versions of wxMac.) You can obtain these from the following URLs:

wxMac-2.8.0 (needed only if you are building the BOINC Manager):

http://www.wxwidgets.org

http://prdownloads.sourceforge.net/wxwindows/wxMac-2.8.0.tar.gz

http://downloads.sourceforge.net/wxwindows/wxMac-2.8.0.tar.bz2

curl-7.16.4:

http://curl.haxx.se

http://curl.haxx.se/download/curl-7.16.4.tar.gz

jpeg-6b (needed only if you are building the BOINC libboinc_graphics_api.a library):

http://www.ijg.org

ftp://ftp.uu.net/graphics/jpeg/jpegsrc.v6b.tar.gz

XCode 2.4.1 installs autoconf 2.59 and automake 1.63. To determine the version number, type 'autoconf --version' or 'automake --version'. Building curl-7.16.4 require autoconf 2.59 and automake 1.93 or later.

Upgrades for autoconf and automake are available from www.gnu.org:

http://ftp.gnu.org/gnu/autoconf/autoconf-2.59.tar.gz

http://ftp.gnu.org/gnu/automake/automake-1.9.3.tar.gz

XCode installed these utilities in the /usr/bin/ directory, but the upgrades by default will install in /usr/local/bin/. If you install there, you must also set your PATH environment variable to include that location. The scripts referenced below do this automatically.

As stated above, all BOINC software for Power PC Macs must be built using GCC 3.3 and MacOS10.3.9 SDK to assure backward compatibility with OS 10.3. All BOINC software for Intel Macs must be built using GCC 4.0 and MacOS10.4.u SDK to allow cross-compiling.

These are not done by either the XCode projects which come with wxMac-2.8.0, nor the AutoMake scripts supplied with wxMac-2.8.0, curl-7.16.4, or jpeg-6b. So be sure to use our special scripts to build these packages.

Building BOINC and the library packages on which it depends requires OS 10.4.4 and XCode 2.4.1 (or greater). It may be possible to use XCode 2.3 and/or versions of OS X earlier than 10.4.4, but this has not been tested by the authors.

  1. Create a parent directory within which to work. In this description , we will call it BOINC_dev, but you can name it anything you wish.
  2. Put the following 3 directories inside the BOINC_dev folder (omit any you don't need):
curl-7.16.4
jpeg-6b
wxMac-2.8.0

Important: do not change the names of any of these 3 directories.

  1. Get the BOINC source tree from SVN, and put it in the same BOINC_dev folder. To do this, type the following in Terminal:
cd {path}/BOINC_dev/
svn co http://boinc.berkeley.edu/svn/trunk/boinc

(You may change the name of the boinc directory to anything you wish.)

The command above retrieves the source code from the HEAD or development branch of the SVN repository. For more information on getting the BOINC source code, see here?.

  1. Run the script to build the curl, jpeg and wxMac libraries as follows:
cd {path}/BOINC_dev/boinc/mac_build/
source setupForBoinc.sh -clean

If you don't wish to force a full rebuild of everything, omit the -clean argument.

Note: this script builds curl first, followed by jpeg and finally wxMac. If you haven't downloaded wxMac because you aren't building the BOINC Manager, the script will build curl and jpeg. Likewise, if you only downloaded curl because you need neither graphics nor the BOINC Manager, the script will build curl before quitting.

  1. Build BOINC as follows:
cd {path}/BOINC_dev/boinc/mac_build/
source BuildMacBOINC.sh

The complete syntax for this script is

source BuildMacBOINC.sh [-dev] [-noclean] [-all] [-lib] [-client]

The options for BuildMacBOINC.sh are:

-dev
build the development (debug) version (native architecture only). default is deployment (release) version (universal binaries: ppc and i386).
-noclean
don't do a 'clean' of each target before building. default is to clean all first.

The following arguments determine which targets to build

-all
build all targets (i.e. target 'Build_All' -- this is the default)
-lib
build the three libraries: libboinc_api.a, libboinc_graphics_api.a, libboinc.a
-client
build two targets: BOINC client and command-line utility boinc_cmd? (also builds libboinc.a, since boinc_cmd requires it.)

Both -lib and -client may be specified to build five targets (no BOINC Manager.)

Note: You may find three XCode projects in the BOINC_dev/boinc/mac_build/ directory:

  • boinc.pbproj is obsolete and should no longer be used.
  • wxMac-BOINC.xcodeproj was needed for building older versions of the wxMac library in conjunction with the older versions of the setupForBoinc.sh or buildWxMac.sh scripts. It is not used for BOINC 5.9.2 or later.
  • boinc.xcodeproj builds BOINC. It can be used either with the BuildMacBOINC.sh script or as a stand-alone project. It has two extra build configurations, i386-Deployment and ppc-Deployment, which can be used for testing only to build for just one architecture. The Development build configuration builds only the native architecture and is used for debugging. The Deployment build configuration builds a universal binary and is suitable for release builds.

Building BOINC Manager Installer

To build the Installer for the BOINC Manager, if the BOINC version number is x.y.z, you must be logged in as an administrator. Type the following in Terminal, then enter your administrator password when prompted by the script:

cd {path}/BOINC_dev/boinc/
source {path}/BOINC_dev/boinc/mac_installer/release_boinc.sh x y z

Substitute the 3 parts of the BOINC version number for x y and z in the above. For example, to build the installer for BOINC version 5.5.4, the command would be

source {path}/BOINC_dev/boinc/mac_installer/release_boinc.sh 5 5 4

This will create a directory 'BOINC_Installer/New_Release_5_5_4' in the BOINC_dev directory.

To build version 5.5.4 of the Grid Republic flavor of BOINC, you would type:

cd {path}/BOINC_dev/boinc/
source {path}/BOINC_dev/boinc/mac_installer/release_GridRepublic.sh 5 5 4

This will create a directory 'BOINC_Installer/New_Release_GR_5_5_4' in the BOINC_dev directory.

Debugging and BOINC security

Version 5.5.4 of BOINC Manager for the Macintosh introduced new, stricter security measures. For details, please see the file Readme.rtf and web pages Sandbox Design and Sandbox User.

The GDB debugger can't attach to applications which are running as a different user or group so it ignores the S_ISUID and S_ISGID permission bits when launching an application. To work around this, BOINC does not use the special boinc_master or boinc_project users or groups when run from XCode.

The Development build only of the BOINC Manager allows you to change the ownership and permission settings of the BOINC Data and executables by entering an administrator user name and password. This also streamlines the development cycle by avoiding the need to run the installer for every change.

To restore the standard ownerships and permissions, run the installer.

Building project applications

Upgrading applications for Macs with Intel processors

Apple began shipping Macs with Intel processors on January 10, and Apple expects to convert all its lines of computers to Intel by the end of 2006.

All future releases of BOINC will include 'universal binary' builds for the Macintosh of BOINC Manager, command-line BOINC client and the boinc_cmd? command-line tool. (Universal binaries contain both PowerPC and Intel executables in one file; the Macintosh OS automatically selects the appropriate one for that computer.)

The advantage of 'universal binaries' is that you only need to have one copy of the application, and it will run on either PowerPC or Intel Macs, so users don't need to choose between two options. Since BOINC participants manually download BOINC from the web site, we will be providing BOINC in 'universal binary' form.

However, participants do not manually download project applications; this is done automatically by BOINC. So there would be no advantage to combining the Intel and PowerPC versions in a single 'universal binary' file, but doing so would double the size of the download.

So BOINC treats Intel Macs as a new, separate platform. BOINC previously directly supported four platforms: PowerPC Macs (powerpc-apple-darwin), Intel Linux (i686-pc-linux-gnu), Windows (windows_intelx86) and Solaris (sparc-sun-solaris2.7).

We have now added a fifth platform for Intel Macs (i686-apple-darwin).

As a temporary measure, projects can set their servers to deliver a copy of their current PowerPC application (renamed for the new platform) under the new i686-apple-darwin platform. The OS will run it in compatibility mode, emulating a PowerPC. (Apple calls this compatibility mode "Rosetta", which of course has nothing to do with the Rosetta BOINC project.)

If you do this, be sure to give your native Intel application a higher version number when you do release it, so that clients will download it.

However, running a PowerPC application in compatibility mode has two significant drawbacks:

  • Screensaver graphics do not work.
  • Since it is running under emulation, your application will run at reduced efficiency. But the benchmarks are based on running native Intel applications. This may cause scheduler problems, such as uncompleted deadlines and inadequate credit for participants.

So it is important to make a native Intel application available as soon as possible. It is very easy to add a new platform to your server with the xadd utility.

BOINC supports all PowerPC Macs running OS 10.3.0 or later, and all Intel Macs. (The Intel Macs themselves require OS 10.4.4 or later.)

The easiest way to build your application for these two platforms is to build each one on its native platform. In other words, do your powerpc-apple-darwin build on a PowerPC Mac running OS 10.3.9, and your i686-apple-darwin build on an Intel Mac.

But Apple provides the tools to allow you to cross-compile your application on any Mac (PowerPC or Intel) running OS 10.4 or later. Here is how:

All BOINC software for Power PC Macs must be built using GCC 3.3 and MacOS 10.3.9 SDK to assure backward compatibility with OS 10.3. If building a PowerPC application on an Intel Mac, you must also specify '-arch ppc' in the compiler and linker flags.

All BOINC software for Intel Macs must be built using GCC 4.0 and MacOS 10.4.u SDK to allow cross-compiling. If building an Intel application on a PowerPC Mac, you must also specify '-arch i386' in the compiler and linker flags.

You can find examples of how to do this for two different kinds of configure / make scripts in the HEAD branch of the BOINC SVN tree at boinc/mac_build/buildcurl.sh and boinc/mac_build/buildjpeg.sh.

The lipo utility is used at the end of each of these scripts to combine the two binaries into a single 'Universal Binary' file. You won't need to do that with you project applications, since you will be distributing them separately under the two platforms. But if you prefer, you can create a Universal Binary and distribute the same file for both i686-apple-darwin and powerpc-apple-darwin platforms.

Note that the BOINC libraries (and any third-party libraries) which you link with your applications must be built with the same configuration as the application itself. Follow the instructions earlier in this document to build the needed libraries.

Additional information on building Unix applications universal can be found here: http://developer.apple.com/documentation/Porting/Conceptual/PortingUnix/compiling/chapter_4_section_3.html

and here: http://developer.apple.com/documentation/MacOSX/Conceptual/universal_binary/universal_binary_compiling/chapter_2_section_7.html

For information on making your code work with GCC 4: http://developer.apple.com/releasenotes/DeveloperTools/GCC40PortingReleaseNotes/index.html

Adding a Finder icon to your application

There is an optional API setMacIcon() in the libboinc_api.a library. This allows science applications to display an application icon in the Dock) and in the Finder. (The icon does not appear in the Dock until the application displays graphics.) To implement this, do the following:

  • Use '/Developer/Applications?/utilities/Icon Composer.app' to create a xxx.icns file. (Use any name you wish instead of xxx.)
  • Convert the xxx.icns file to an app_icon.h file as follows: in Terminal, run:
{path}/MakeAppIcon_h {source_file_path}/xxx.icns {dest_file_path}/app_icon.h

(The !MakeAppIcon_h command-line utility is built by the Mac boinc XCode project in the 'boinc/mac_build/build/' directory.) Add the app_icon.h file to your science application's project.

  • In the science application's main(), add
#include "app_icon.h" 

and call:

setMacIcon(argv[0], MacAppIconData, sizeof(MacAppIconData));
  • The science application must link with Carbon.framework to use setMacIcon().