Project

General

Profile

Preparing a Mac machine for Bilder » History » Version 83

David Alexander, 02/23/2022 02:34 PM

1 2 Redmine Admin
# Preparing a Mac machine for Bilder #
2 1 Redmine Admin
3 70 John Cary
*NOTE: as of Catalina, installing in /opt is no longer an option, so we have moved to /usr/local*
4
5 24 John Cary
__If all you need is python and sphinx__ (e.g., for builds of documentation), then you need only
6
7
* XCode with command line tools
8
* Latex installed as noted below
9
10
and then you can add the arguments,  -W python, and your installed Python and CMake will be used if your path is correct.
11
12
13 2 Redmine Admin
## Bilder on Darwin ##
14 1 Redmine Admin
15 16 John Cary
Darwin comes with bash, so it is Bilder ready for the most part.
16 1 Redmine Admin
17 16 John Cary
### OS X Versions ###
18 1 Redmine Admin
19 16 John Cary
Yosemite's XCode that supports C++ 11 by default.
20 1 Redmine Admin
21 16 John Cary
El Capitan's clang compiler supports OpenMP.
22
23 1 Redmine Admin
## Case insensitive file system ##
24
25
We have noted and filed bugs for CMake errors on OS X when using the case-sensitive file system. To fix we use the case-insensitive file system. There may be problems with various packages and the case-insensitive file system.
26
27 2 Redmine Admin
## C and C++ compilers and Xcode command line tools ##
28 1 Redmine Admin
29 83 David Alexander
Install Xcode. To obtain version 11.3 (11.x is required for LLVM@12), visit https://developer.apple.com/xcode/download, then at the bottom third of the page, click on the "Additional Tools" link . Sign in with your Apple ID. Also download the Command Line Tools to match the version of Xcode that you are getting. The Xcode.app directory that is unpacked by opening the .xip file should be moved to the /Applications/ folder. The Command Line Tools is a DMG that has a PKG installer, so just run that. One must additionally execute this command before using any command line tools:
30 1 Redmine Admin
31
~~~~~~
32 83 David Alexander
sudo xcodebuild -license
33 1 Redmine Admin
~~~~~~
34
35 83 David Alexander
If you are upgrading from a previous installation you will want/need to run the following command
36 35 John Cary
37
~~~~~~
38 83 David Alexander
sudo xcode-select -s /Applications/Xcode.app
39 1 Redmine Admin
~~~~~~
40
41 83 David Alexander
One can check the version of Xcode from the command-line with
42 69 John Cary
43 83 David Alexander
~~~~~
44
xcodebuild -version
45
/usr/bin/clang --version
46 69 John Cary
~~~~~~
47 65 David Alexander
48 83 David Alexander
The clang should be version 11.0.0 with Xcode 11.3.1.
49 1 Redmine Admin
50
## HomeBrew ##
51 70 John Cary
52 1 Redmine Admin
One must select a non-OSX package manager for some additional packages. The candidates are HomeBrew, MacPorts, and Fink, with the HomeBrew being our recommendation at this time, as it is active, and it has the philosophy of not building extraneous stuff that is already present on OSX, which MacPorts tends to do, thus using up more disk space.  HomeBrew also installs packages in their own subdirs with links to other places in /usr/local/homebrew, thus making removal a matter removing a directory and then removing broken links in /usr/local/homebrew.
53 14 John Cary
54 1 Redmine Admin
HomeBrew requires that one not have root privileges.  So we make the directory into which we can write:
55
56 29 John Cary
~~~~~~
57 70 John Cary
sudo -s
58
mkdir -p /usr/local/homebrew
59 1 Redmine Admin
chgrp -R admin /usr/local/homebrew
60 77 John Cary
chmod -R 2775 /usr/local/homebrew
61
mkdir -p /usr/local/opt
62
chgrp -R admin /usr/local/opt
63 1 Redmine Admin
chmod -R 2775 /usr/local/opt
64 14 John Cary
exit
65
~~~~~~
66 1 Redmine Admin
67
and then we work as nonroot:
68 70 John Cary
69 57 John Cary
~~~~~~
70
cd /usr/local
71 39 David Alexander
git clone https://github.com/Homebrew/brew.git homebrew
72
~~~~~~
73
74 70 John Cary
~~~~~~
75
chmod -R a+rX /usr/local/homebrew
76 1 Redmine Admin
find /usr/local/homebrew -type l -exec chmod -h a+r '{}' \;
77
~~~~~~
78 73 Benjamin Cowan
79 1 Redmine Admin
These last two lines can be reused at anytime there is a permissions problem.
80 39 David Alexander
81
As root again execute these lines to pick up some paths in the defaults paths:
82 1 Redmine Admin
83 29 John Cary
~~~~~~
84 70 John Cary
sudo -s
85
echo "/usr/local/homebrew/bin" > /etc/paths.d/homebrew
86 29 John Cary
echo "/usr/local/homebrew/share/man" > /etc/manpaths.d/homebrew
87
chmod a+r /etc/paths.d/homebrew /etc/manpaths.d/homebrew
88 1 Redmine Admin
exit
89
~~~~~~
90 82 John Cary
91 1 Redmine Admin
Get various packages...
92 16 John Cary
93 82 John Cary
~~~~~~
94 16 John Cary
brew install subversion gnupg libpng freetype gd ghostscript ninja wget imagemagick
95
~~~~~~
96 45 Nathan Neri
97
git large file support (for VisIt)
98
99
~~~~~~
100 56 Nathan Neri
brew install git-lfs
101 45 Nathan Neri
git lfs install --force --skip-smudge
102
~~~~~~
103 25 David Howdle
104
For Qt5:
105
106
~~~~~~
107 39 David Alexander
brew install bison flex gperf libcapn
108 1 Redmine Admin
~~~~~~
109 79 John Cary
110 75 Tech-X Corporation
Fortran comes with the homebrew gcc compiler:
111
112 81 David Alexander
~~~~~~
113 1 Redmine Admin
brew install gcc
114
~~~~~~
115 81 David Alexander
116 79 John Cary
As of Sep 2021, version 11.2 has been tried with success.
117 1 Redmine Admin
However, it does not work an Apple Silicon (M1), so you must instead get it from https://github.com/fxcoudert/gfortran-for-macOS/releases/tag/11-arm-alpha2.
118 39 David Alexander
119
OPTIONAL:
120
121
If you receive an error regarding ruby version:
122
123
~~~~~~
124
brew install ruby@2.3
125
~~~~~~
126
127
may help.
128 1 Redmine Admin
129
130
## LaTeX ##
131
132 29 John Cary
Those with sufficient hard drive space (3.4GB after install) may wish to download the full MacTeX package from <http://www.tug.org/mactex/downloading.html>. After installing, one can see the 'README ME FIRST.pdf' in /Applications/Tex. You will likely need to add /usr/texbin to your path:
133
134 1 Redmine Admin
~~~~~~
135 13 Redmine Admin
setenv PATH /usr/texbin:${PATH}  # For tcsh
136 1 Redmine Admin
export PATH=/usr/texbin:${PATH}  # For bash
137
~~~~~~
138 13 Redmine Admin
139
For those who like GUIs, the !TeXworks in /Applications/TeX/TeXworks should work fine.
140
141 32 John Cary
For those with limited space, install BasicTeX from <https://tug.org/mactex/morepackages.html>. Add to your PATH:
142 13 Redmine Admin
143
~~~~~~
144 32 John Cary
    /usr/local/texlive/2017/bin/universal-darwin/
145 1 Redmine Admin
~~~~~~
146 32 John Cary
147 29 John Cary
and then install the packages noted at
148 32 John Cary
149 1 Redmine Admin
[[LaTeX packages needed by Bilder]]
150
151 32 John Cary
You may need to use sudo.
152
153 1 Redmine Admin
~~~~~~
154 29 John Cary
sudo tlmgr update --self
155 32 John Cary
sudo tlmgr install <needed packages>
156
~~~~~~
157 1 Redmine Admin
158
and then used the autoupdate feature to get any additionally needed packages.  This minimal installation is 230 M instead of the usual 2GB.
159
160
161
## Disable spindump ##
162
163
for faster compilations via
164
165
~~~~~~
166 58 John Cary
sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.spindump.plist
167
~~~~~~
168 67 David Alexander
169 58 John Cary
## LLVM-Clang ##
170
171
LLVM-Clang (aka LlvmClang) is different from AppleClang.  It has support for target attributes and openmp, and provides a build chain for high-performance computing.  Check out the llvm-project of your chosen version.
172
173
We use homebrew to install this with
174 61 John Cary
175 71 David Alexander
~~~~~~
176 83 David Alexander
brew install llvm@12
177 1 Redmine Admin
~~~~~~
178 78 John Cary
179 83 David Alexander
As of Feb 2022, the default llvm version is 13 and that would be probably fine, however 12 is tested and is known to be ok.
180 78 John Cary
181 1 Redmine Admin
ALTERNATIVE
182 78 John Cary
183 1 Redmine Admin
If brew does not work (e.g., it is not available for M1), then you can download a release from https://github.com/llvm/llvm-project/releases.
184
185 48 Nathan Neri
To configure and build:
186 49 Nathan Neri
187 80 John Cary
~~~~~~
188
llvmver=12.0.0 # Correct as needed.
189
tar xf llvmorg-$llvmver.tar.gz
190 1 Redmine Admin
cd llvm-project-llvmorg-$llvmver
191
mkdir build
192 80 John Cary
cd build
193 77 John Cary
cmake ../llvm -DLLVM_ENABLE_PROJECTS="clang;openmp;libcxx;libcxxabi" -DLLVM_ENABLE_RTTI:BOOL=ON -DLLVM_ENABLE_EH:BOOL=ON -DCMAKE_INSTALL_PREFIX:PATH="/usr/local/opt/llvm-$llvmver/install" -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_NAME_DIR=/usr/local/opt/llvm-$llvmver/install/lib
194 54 David Alexander
make # Add appropriate -j argument for the machine to build faster
195
          # with -j 8 on qamojavellvm the build and installation took a little under an hour
196 48 Nathan Neri
make install
197
~~~~~~
198
199 43 Tech-X Corporation
Bilder will look in /opt/llvmclang/bin for llvm binaries (as well as $LLVM_DIR/bin, and your installation dir/bin, in case you need to keep multiple versions for different builds), so we set a link to the installation directory in the chosen version of llvm:
200 44 Tech-X Corporation
201 78 John Cary
~~~~~~
202 48 Nathan Neri
cd /usr/local/opt
203 44 Tech-X Corporation
sudo ln -s llvm-<Version>/install llvmclang
204 43 Tech-X Corporation
~~~~~~
205 11 Redmine Admin
206
## Java ##
207
208
You will need to install java by invoking the executable in any way such as...
209
210
~~~~~~
211 1 Redmine Admin
java -version
212
~~~~~~
213 74 Tech-X Corporation
214
Follow the instructions in the dialog that takes you to the Oracle website and choose the latest version to download.  (As of March 2021 this is 16.)
215
216
Chose the macOS installer from
217 1 Redmine Admin
https://www.oracle.com/java/technologies/javase-jdk16-downloads.html
218
219 2 Redmine Admin
## HostName ##
220 1 Redmine Admin
221 31 John Cary
For bilder to properly send emails the fully qualified hostname must set on the machine. To check this try...
222 29 John Cary
223 1 Redmine Admin
~~~~~~
224
hostname -f
225
~~~~~~
226
227
this should return machinename.domainname.com rather than just machinename.  If it does not, then set the hostname of the machine by typing the following commands.
228
229
~~~~~~
230
sudo scutil --set ComputerName "machinename"
231
sudo scutil --set LocalHostName "machinename"
232
sudo scutil --set HostName "machinename.domainname.com"
233
dscacheutil -flushcache
234
~~~~~~
235
236
Restart your Mac after this.
237
238
## Power Saving Modes ##
239
240
For build machines that are not personal machines, disabling certain options will help in connectivity and responsiveness:
241
242
~~~~~~
243
Under Spotlight
244
 - disabled the main HD. (multiple mdworkers taking up a lot of cpu.)
245
~~~~~~
246
247
~~~~~~
248
Under Energy Saver
249
 - Computer sleep: Set to never
250
 - Unchecked Put hard disks to sleep when possible
251
 - Unchecked Wake for network access
252
~~~~~~
253
254
&nbsp;
255
&nbsp;
256
&nbsp;
257
&nbsp;
258
&nbsp;
259
&nbsp;
260
&nbsp;
261
&nbsp;
262 29 John Cary
&nbsp;
263
&nbsp;
264
265
---
266 31 John Cary
267 1 Redmine Admin
---
268 31 John Cary
269
## X11 ##
270
271
X11 should not be needed, but if it is needed:
272
273
Install [XQuartz X11](http://xquartz.macosforge.org/landing/).
274
275
Create a symbolic link so that the X11 headers can be found by the compiler:
276
277
~~~~~~
278 1 Redmine Admin
sudo ln -s /opt/X11/include/X11 /usr/local/include/X11
279 31 John Cary
~~~~~~
280
281
# DEPRECATED INSTRUCTIONS #
282
283
284
## Other gfortran options (besides HomeBrew) ##
285
286
### Option 2: HPC ###
287
288
Install gfortran from [SourceForge HPC](http://hpc.sourceforge.net).  (Do not also install the other gcc compilers.)
289
290
As of March 29, 2015, the version is 4.9.0.
291
292
Install via
293
294
~~~~~~
295
$ tar xzf gfortran-4.9-bin.tar.gz -C /
296
~~~~~~
297
298
### Option 3: GNU ###
299
300
Install gfortran using the installer from <http://gcc.gnu.org/wiki/GFortranBinaries>.
301
302
As of March 29, 2015, the version is 4.9.0.
303 30 John Cary
304
The binaries will end up being installed in /usr/local/bin
305
306
307 11 Redmine Admin
## Git ##
308 1 Redmine Admin
309 10 Redmine Admin
If any repository package requires Git protocol, then for Lion and earlier you may need Git from <http://git-scm.com/download/mac> and add /usr/local/git/bin to your path.
310
311
312 11 Redmine Admin
### Macports ### 
313
314
This provides wget, freetype, and other utilities. Get macports from <http://www.macports.org/install.php> and install.
315 10 Redmine Admin
316 29 John Cary
Note: Before proceeding with the installation of various macports packages noted below on Lion machines with Xcode 4.3, one needs to run
317 10 Redmine Admin
318
~~~~~~
319
sudo xcode-select -switch /Applications/Xcode.app
320 11 Redmine Admin
~~~~~~
321
322 1 Redmine Admin
Otherwise, there will be an error installing zlib during the wget installation below.
323
324 29 John Cary
After the macports installation, do
325
326
~~~~~~
327 1 Redmine Admin
sudo port install wget
328
sudo port install ImageMagick +no_x11
329
sudo port install f2c
330
~~~~~~
331
332 11 Redmine Admin
333 1 Redmine Admin
### XCode ###
334
### Lion ###
335
336 2 Redmine Admin
On Lion, the command line compilers are not installed automatically. After installing Xcode, navigate to the 
337 1 Redmine Admin
Preferences->Download dialog 
338
and install the Command Line Tools. The dialog is.. 
339
340
!screenShotCommandLineTools.png!
341 11 Redmine Admin
342 29 John Cary
or from the command line do
343
344 1 Redmine Admin
~~~~~~
345
sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer/
346
xcodebuild
347
      (hit agree)
348
~~~~~~
349
350
You may subsequently need to build your first package with sudo in order to accept the Xcode licenses.
351
352
### Mountain Lion ### 
353
354
Same as Mavericks?
355 2 Redmine Admin
356 29 John Cary
### Mavericks ###
357 1 Redmine Admin
358
~~~~~~
359
sudo xcode-select --install
360
~~~~~~
361
362
363
## Java ##
364
365
(The below does not apply to yosemite.)
366
367 29 John Cary
The cmake build may fail due to missing java headers linked to in /System/Library/Frameworks/JavaVM.framework/Headers. To fix:
368
369 1 Redmine Admin
~~~~~~
370
cd /System/Library/Frameworks/JavaVM.framework/Headers
371
sudo mv jni.h jni.h.missing
372
~~~~~~