Project

General

Profile

Preparing a Mac machine for Bilder » History » Version 85

David Alexander, 02/24/2022 10:21 AM

1 2 Redmine Admin
# Preparing a Mac machine for Bilder #
2 1 Redmine Admin
3 70 John Cary
*NOTE: as of Catalina, installing in /opt is no longer an option, so we have moved to /usr/local*
4
5 24 John Cary
__If all you need is python and sphinx__ (e.g., for builds of documentation), then you need only
6
7
* XCode with command line tools
8
* Latex installed as noted below
9
10
and then you can add the arguments,  -W python, and your installed Python and CMake will be used if your path is correct.
11
12
13 2 Redmine Admin
## Bilder on Darwin ##
14 1 Redmine Admin
15 16 John Cary
Darwin comes with bash, so it is Bilder ready for the most part.
16 1 Redmine Admin
17 16 John Cary
### OS X Versions ###
18 1 Redmine Admin
19 16 John Cary
Yosemite's XCode that supports C++ 11 by default.
20 1 Redmine Admin
21 16 John Cary
El Capitan's clang compiler supports OpenMP.
22
23 1 Redmine Admin
## Case insensitive file system ##
24
25
We have noted and filed bugs for CMake errors on OS X when using the case-sensitive file system. To fix we use the case-insensitive file system. There may be problems with various packages and the case-insensitive file system.
26
27 2 Redmine Admin
## C and C++ compilers and Xcode command line tools ##
28 1 Redmine Admin
29 83 David Alexander
Install Xcode. To obtain version 11.3 (11.x is required for LLVM@12), visit https://developer.apple.com/xcode/download, then at the bottom third of the page, click on the "Additional Tools" link . Sign in with your Apple ID. Also download the Command Line Tools to match the version of Xcode that you are getting. The Xcode.app directory that is unpacked by opening the .xip file should be moved to the /Applications/ folder. The Command Line Tools is a DMG that has a PKG installer, so just run that. One must additionally execute this command before using any command line tools:
30 1 Redmine Admin
31
~~~~~~
32 83 David Alexander
sudo xcodebuild -license
33 1 Redmine Admin
~~~~~~
34
35 83 David Alexander
If you are upgrading from a previous installation you will want/need to run the following command
36 35 John Cary
37
~~~~~~
38 83 David Alexander
sudo xcode-select -s /Applications/Xcode.app
39 1 Redmine Admin
~~~~~~
40
41 83 David Alexander
One can check the version of Xcode from the command-line with
42 69 John Cary
43 83 David Alexander
~~~~~
44
xcodebuild -version
45
/usr/bin/clang --version
46 69 John Cary
~~~~~~
47 65 David Alexander
48 83 David Alexander
The clang should be version 11.0.0 with Xcode 11.3.1.
49 1 Redmine Admin
50
## HomeBrew ##
51 70 John Cary
52 1 Redmine Admin
One must select a non-OSX package manager for some additional packages. The candidates are HomeBrew, MacPorts, and Fink, with the HomeBrew being our recommendation at this time, as it is active, and it has the philosophy of not building extraneous stuff that is already present on OSX, which MacPorts tends to do, thus using up more disk space.  HomeBrew also installs packages in their own subdirs with links to other places in /usr/local/homebrew, thus making removal a matter removing a directory and then removing broken links in /usr/local/homebrew.
53 14 John Cary
54 84 David Alexander
HomeBrew requires that one not have root privileges, but /usr/local is owned by root, we make the directory into which we can write. If you are in the admin group on your own Mac, then you can run the following commands:
55 1 Redmine Admin
56
~~~~~~
57 14 John Cary
cd /usr/local
58 84 David Alexander
sudo mkdir homebrew
59
sudo chown `whoami` homebrew
60
chgrp admin homebrew
61
chmod 2775 homebrew
62 70 John Cary
git clone https://github.com/Homebrew/brew.git homebrew
63 57 John Cary
~~~~~~
64
65 84 David Alexander
These commands are useful if you do encounter any permissions problems or are on a Mac that is shared for building.
66
67 1 Redmine Admin
~~~~~~
68
chmod -R a+rX /usr/local/homebrew
69 73 Benjamin Cowan
find /usr/local/homebrew -type l -exec chmod -h a+r '{}' \;
70 1 Redmine Admin
~~~~~~
71 39 David Alexander
72 84 David Alexander
Finally, as root execute these lines to pick up some paths in the defaults paths:
73 1 Redmine Admin
74 29 John Cary
~~~~~~
75 70 John Cary
sudo -s
76
echo "/usr/local/homebrew/bin" > /etc/paths.d/homebrew
77 29 John Cary
echo "/usr/local/homebrew/share/man" > /etc/manpaths.d/homebrew
78
chmod a+r /etc/paths.d/homebrew /etc/manpaths.d/homebrew
79 1 Redmine Admin
exit
80
~~~~~~
81 82 John Cary
82 1 Redmine Admin
Get various packages...
83 16 John Cary
84 82 John Cary
~~~~~~
85 16 John Cary
brew install subversion gnupg libpng freetype gd ghostscript ninja wget imagemagick
86
~~~~~~
87 45 Nathan Neri
88
git large file support (for VisIt)
89
90
~~~~~~
91 56 Nathan Neri
brew install git-lfs
92 45 Nathan Neri
git lfs install --force --skip-smudge
93
~~~~~~
94 25 David Howdle
95
For Qt5:
96
97
~~~~~~
98 39 David Alexander
brew install bison flex gperf libcapn
99 1 Redmine Admin
~~~~~~
100 79 John Cary
101 75 Tech-X Corporation
Fortran comes with the homebrew gcc compiler:
102
103 81 David Alexander
~~~~~~
104 1 Redmine Admin
brew install gcc
105
~~~~~~
106 81 David Alexander
107 79 John Cary
As of Sep 2021, version 11.2 has been tried with success.
108 1 Redmine Admin
However, it does not work an Apple Silicon (M1), so you must instead get it from https://github.com/fxcoudert/gfortran-for-macOS/releases/tag/11-arm-alpha2.
109 39 David Alexander
110
OPTIONAL:
111
112
If you receive an error regarding ruby version:
113
114
~~~~~~
115
brew install ruby@2.3
116
~~~~~~
117
118
may help.
119 1 Redmine Admin
120
121
## LaTeX ##
122
123 29 John Cary
Those with sufficient hard drive space (3.4GB after install) may wish to download the full MacTeX package from <http://www.tug.org/mactex/downloading.html>. After installing, one can see the 'README ME FIRST.pdf' in /Applications/Tex. You will likely need to add /usr/texbin to your path:
124
125 1 Redmine Admin
~~~~~~
126 13 Redmine Admin
setenv PATH /usr/texbin:${PATH}  # For tcsh
127 1 Redmine Admin
export PATH=/usr/texbin:${PATH}  # For bash
128
~~~~~~
129 13 Redmine Admin
130
For those who like GUIs, the !TeXworks in /Applications/TeX/TeXworks should work fine.
131
132 32 John Cary
For those with limited space, install BasicTeX from <https://tug.org/mactex/morepackages.html>. Add to your PATH:
133 13 Redmine Admin
134
~~~~~~
135 32 John Cary
    /usr/local/texlive/2017/bin/universal-darwin/
136 1 Redmine Admin
~~~~~~
137 32 John Cary
138 29 John Cary
and then install the packages noted at
139 32 John Cary
140 1 Redmine Admin
[[LaTeX packages needed by Bilder]]
141
142 32 John Cary
You may need to use sudo.
143
144 1 Redmine Admin
~~~~~~
145 29 John Cary
sudo tlmgr update --self
146 32 John Cary
sudo tlmgr install <needed packages>
147
~~~~~~
148 1 Redmine Admin
149
and then used the autoupdate feature to get any additionally needed packages.  This minimal installation is 230 M instead of the usual 2GB.
150
151
152
## Disable spindump ##
153
154
for faster compilations via
155
156
~~~~~~
157 58 John Cary
sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.spindump.plist
158
~~~~~~
159 67 David Alexander
160 58 John Cary
## LLVM-Clang ##
161
162
LLVM-Clang (aka LlvmClang) is different from AppleClang.  It has support for target attributes and openmp, and provides a build chain for high-performance computing.  Check out the llvm-project of your chosen version.
163
164
We use homebrew to install this with
165 61 John Cary
166 71 David Alexander
~~~~~~
167 83 David Alexander
brew install llvm@12
168 1 Redmine Admin
~~~~~~
169 78 John Cary
170 85 David Alexander
As of Feb 2022, the default llvm version is 13 and that would be probably fine, however 12 is tested and is known to be ok. Ensure that there is a link at /usr/local/homebrew/opt/llvm that points to the installation so bilder can properly find it. If not then do something like the following (this example is for version 12):
171
172
~~~~~~
173
cd /usr/local/homebrew/opt
174
ln -s ../Cellar/llvm\@12/12.0.1_1 llvm
175
~~~~~~
176
177 78 John Cary
178 1 Redmine Admin
ALTERNATIVE
179 78 John Cary
180 1 Redmine Admin
If brew does not work (e.g., it is not available for M1), then you can download a release from https://github.com/llvm/llvm-project/releases.
181
182 48 Nathan Neri
To configure and build:
183 49 Nathan Neri
184 80 John Cary
~~~~~~
185
llvmver=12.0.0 # Correct as needed.
186
tar xf llvmorg-$llvmver.tar.gz
187 1 Redmine Admin
cd llvm-project-llvmorg-$llvmver
188
mkdir build
189 80 John Cary
cd build
190 77 John Cary
cmake ../llvm -DLLVM_ENABLE_PROJECTS="clang;openmp;libcxx;libcxxabi" -DLLVM_ENABLE_RTTI:BOOL=ON -DLLVM_ENABLE_EH:BOOL=ON -DCMAKE_INSTALL_PREFIX:PATH="/usr/local/opt/llvm-$llvmver/install" -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_NAME_DIR=/usr/local/opt/llvm-$llvmver/install/lib
191 54 David Alexander
make # Add appropriate -j argument for the machine to build faster
192
          # with -j 8 on qamojavellvm the build and installation took a little under an hour
193 48 Nathan Neri
make install
194
~~~~~~
195
196 43 Tech-X Corporation
Bilder will look in /opt/llvmclang/bin for llvm binaries (as well as $LLVM_DIR/bin, and your installation dir/bin, in case you need to keep multiple versions for different builds), so we set a link to the installation directory in the chosen version of llvm:
197 44 Tech-X Corporation
198 78 John Cary
~~~~~~
199 48 Nathan Neri
cd /usr/local/opt
200 44 Tech-X Corporation
sudo ln -s llvm-<Version>/install llvmclang
201 43 Tech-X Corporation
~~~~~~
202 11 Redmine Admin
203
## Java ##
204
205
You will need to install java by invoking the executable in any way such as...
206
207
~~~~~~
208 1 Redmine Admin
java -version
209
~~~~~~
210 74 Tech-X Corporation
211
Follow the instructions in the dialog that takes you to the Oracle website and choose the latest version to download.  (As of March 2021 this is 16.)
212
213
Chose the macOS installer from
214 1 Redmine Admin
https://www.oracle.com/java/technologies/javase-jdk16-downloads.html
215
216 2 Redmine Admin
## HostName ##
217 1 Redmine Admin
218 31 John Cary
For bilder to properly send emails the fully qualified hostname must set on the machine. To check this try...
219 29 John Cary
220 1 Redmine Admin
~~~~~~
221
hostname -f
222
~~~~~~
223
224
this should return machinename.domainname.com rather than just machinename.  If it does not, then set the hostname of the machine by typing the following commands.
225
226
~~~~~~
227
sudo scutil --set ComputerName "machinename"
228
sudo scutil --set LocalHostName "machinename"
229
sudo scutil --set HostName "machinename.domainname.com"
230
dscacheutil -flushcache
231
~~~~~~
232
233
Restart your Mac after this.
234
235
## Power Saving Modes ##
236
237
For build machines that are not personal machines, disabling certain options will help in connectivity and responsiveness:
238
239
~~~~~~
240
Under Spotlight
241
 - disabled the main HD. (multiple mdworkers taking up a lot of cpu.)
242
~~~~~~
243
244
~~~~~~
245
Under Energy Saver
246
 - Computer sleep: Set to never
247
 - Unchecked Put hard disks to sleep when possible
248
 - Unchecked Wake for network access
249
~~~~~~
250
251
&nbsp;
252
&nbsp;
253
&nbsp;
254
&nbsp;
255
&nbsp;
256
&nbsp;
257
&nbsp;
258
&nbsp;
259 29 John Cary
&nbsp;
260
&nbsp;
261
262
---
263 31 John Cary
264 1 Redmine Admin
---
265 31 John Cary
266
## X11 ##
267
268
X11 should not be needed, but if it is needed:
269
270
Install [XQuartz X11](http://xquartz.macosforge.org/landing/).
271
272
Create a symbolic link so that the X11 headers can be found by the compiler:
273
274
~~~~~~
275 1 Redmine Admin
sudo ln -s /opt/X11/include/X11 /usr/local/include/X11
276 31 John Cary
~~~~~~
277
278
# DEPRECATED INSTRUCTIONS #
279
280
281
## Other gfortran options (besides HomeBrew) ##
282
283
### Option 2: HPC ###
284
285
Install gfortran from [SourceForge HPC](http://hpc.sourceforge.net).  (Do not also install the other gcc compilers.)
286
287
As of March 29, 2015, the version is 4.9.0.
288
289
Install via
290
291
~~~~~~
292
$ tar xzf gfortran-4.9-bin.tar.gz -C /
293
~~~~~~
294
295
### Option 3: GNU ###
296
297
Install gfortran using the installer from <http://gcc.gnu.org/wiki/GFortranBinaries>.
298
299
As of March 29, 2015, the version is 4.9.0.
300 30 John Cary
301
The binaries will end up being installed in /usr/local/bin
302
303
304 11 Redmine Admin
## Git ##
305 1 Redmine Admin
306 10 Redmine Admin
If any repository package requires Git protocol, then for Lion and earlier you may need Git from <http://git-scm.com/download/mac> and add /usr/local/git/bin to your path.
307
308
309 11 Redmine Admin
### Macports ### 
310
311
This provides wget, freetype, and other utilities. Get macports from <http://www.macports.org/install.php> and install.
312 10 Redmine Admin
313 29 John Cary
Note: Before proceeding with the installation of various macports packages noted below on Lion machines with Xcode 4.3, one needs to run
314 10 Redmine Admin
315
~~~~~~
316
sudo xcode-select -switch /Applications/Xcode.app
317 11 Redmine Admin
~~~~~~
318
319 1 Redmine Admin
Otherwise, there will be an error installing zlib during the wget installation below.
320
321 29 John Cary
After the macports installation, do
322
323
~~~~~~
324 1 Redmine Admin
sudo port install wget
325
sudo port install ImageMagick +no_x11
326
sudo port install f2c
327
~~~~~~
328
329 11 Redmine Admin
330 1 Redmine Admin
### XCode ###
331
### Lion ###
332
333 2 Redmine Admin
On Lion, the command line compilers are not installed automatically. After installing Xcode, navigate to the 
334 1 Redmine Admin
Preferences->Download dialog 
335
and install the Command Line Tools. The dialog is.. 
336
337
!screenShotCommandLineTools.png!
338 11 Redmine Admin
339 29 John Cary
or from the command line do
340
341 1 Redmine Admin
~~~~~~
342
sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer/
343
xcodebuild
344
      (hit agree)
345
~~~~~~
346
347
You may subsequently need to build your first package with sudo in order to accept the Xcode licenses.
348
349
### Mountain Lion ### 
350
351
Same as Mavericks?
352 2 Redmine Admin
353 29 John Cary
### Mavericks ###
354 1 Redmine Admin
355
~~~~~~
356
sudo xcode-select --install
357
~~~~~~
358
359
360
## Java ##
361
362
(The below does not apply to yosemite.)
363
364 29 John Cary
The cmake build may fail due to missing java headers linked to in /System/Library/Frameworks/JavaVM.framework/Headers. To fix:
365
366 1 Redmine Admin
~~~~~~
367
cd /System/Library/Frameworks/JavaVM.framework/Headers
368
sudo mv jni.h jni.h.missing
369
~~~~~~