Project

General

Profile

Preparing a Mac machine for Bilder » History » Version 48

Nathan Neri, 03/14/2019 01:44 PM
Changing instructions from downloading llvm binaries (at 7.0.0/7.0.1) to building from source (at 9.0.0) with openmp and exception handling.

1 2 Redmine Admin
# Preparing a Mac machine for Bilder #
2 1 Redmine Admin
3 24 John Cary
__If all you need is python and sphinx__ (e.g., for builds of documentation), then you need only
4
5
* XCode with command line tools
6
* Latex installed as noted below
7
8
and then you can add the arguments,  -W python, and your installed Python and CMake will be used if your path is correct.
9
10
11 2 Redmine Admin
## Bilder on Darwin ##
12 1 Redmine Admin
13 16 John Cary
Darwin comes with bash, so it is Bilder ready for the most part.
14 1 Redmine Admin
15 16 John Cary
### OS X Versions ###
16 1 Redmine Admin
17 16 John Cary
Yosemite's XCode that supports C++ 11 by default.
18 1 Redmine Admin
19 16 John Cary
El Capitan's clang compiler supports OpenMP.
20
21 1 Redmine Admin
## Case insensitive file system ##
22
23
We have noted and filed bugs for CMake errors on OS X when using the case-sensitive file system. To fix we use the case-insensitive file system. There may be problems with various packages and the case-insensitive file system.
24
25 2 Redmine Admin
## C and C++ compilers and Xcode command line tools ##
26 1 Redmine Admin
27
Install Xcode. To obtain version 6, visit https://developer.apple.com/xcode/download, then at the bottom third of the page, click on the "Additional Tools" link . Sign in with your Apple ID.  
28
29
~~~~~~
30 31 John Cary
sudo xcode-select --install
31 1 Redmine Admin
~~~~~~
32
33 35 John Cary
With mojave, one must additionally
34
35
~~~~~~
36
sudo installer -pkg /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg -target /
37
~~~~~~
38
39
But https://apple.stackexchange.com/questions/337940/why-is-usr-include-missing-i-have-xcode-and-command-line-tools-installed-moja says it is better to use `xcrun --show-sdk-path` to figure this out.
40
41 1 Redmine Admin
## HomeBrew ##
42
43
One must select a non-OSX package manager for some additional packages. The candidates are HomeBrew, MacPorts, and Fink, with the HomeBrew being our recommendation at this time, as it is active, and it has the philosophy of not building extraneous stuff that is already present on OSX, which MacPorts tends to do, thus using up more disk space.  HomeBrew also installs packages in their own subdirs with links to other places in /opt, thus making removal a matter removing a directory and then removing broken links in /opt/homebrew.
44
45 14 John Cary
HomeBrew requires that one not have root privileges.  So we make the directory into which we can write:
46 1 Redmine Admin
47
~~~~~~
48 29 John Cary
sudo -s
49
mkdir -p /opt/homebrew
50
chgrp -R admin /opt
51
chmod -R 775 /opt
52
chmod -R 2775 /opt/homebrew
53
exit
54 14 John Cary
~~~~~~
55
56
and then we work as nonroot:
57
58
~~~~~~
59 29 John Cary
cd /opt
60
curl -L https://github.com/Homebrew/brew/tarball/master | tar xz --strip 1 -C homebrew
61 39 David Alexander
~~~~~~
62
63
~~~~~~
64 29 John Cary
chmod -R a+rX /opt/homebrew
65 14 John Cary
find /opt/homebrew -type l -exec chmod -h a+r '{}' \;
66 1 Redmine Admin
~~~~~~
67
68 39 David Alexander
These last too lines can be reused at anytime there is a permissions problem.
69 1 Redmine Admin
70 39 David Alexander
As root again execute these lines to pick up some paths in the defaults paths:
71
72 1 Redmine Admin
~~~~~~
73 29 John Cary
sudo -s
74
echo "/opt/homebrew/bin" > /etc/paths.d/homebrew
75
echo "/opt/homebrew/share/man" > /etc/manpaths.d/homebrew
76
chmod a+r /etc/paths.d/homebrew /etc/manpaths.d/homebrew
77
exit
78 1 Redmine Admin
~~~~~~
79
80
Get the required packages...
81
82
~~~~~~
83 29 John Cary
brew install gnupg libpng freetype gd ghostscript
84 1 Redmine Admin
~~~~~~
85
86 16 John Cary
Nice to have:
87 1 Redmine Admin
88 16 John Cary
~~~~~~
89 29 John Cary
brew install imagemagick
90 16 John Cary
~~~~~~
91
92 45 Nathan Neri
git large file support (for VisIt)
93
94
~~~~~~
95
brew install git-lfs
96 47 Nathan Neri
git lfs install
97 45 Nathan Neri
~~~~~~
98
99 25 David Howdle
For Qt5:
100
101
~~~~~~
102
brew install bison flex gperf libcapn
103 1 Redmine Admin
~~~~~~
104 25 David Howdle
105 39 David Alexander
To get fortran, which comes with the gcc compiler:
106 1 Redmine Admin
107
~~~~~~
108 39 David Alexander
brew install gcc@6
109 1 Redmine Admin
~~~~~~
110
111 39 David Alexander
With versions older than gcc 6.5 (released Nov 2018) possibly needed for OSs older than Mojave, gfortran is not installed with gcc and you need to add the following argument "--with-fortran" to the above brew install command.
112 1 Redmine Admin
113 39 David Alexander
OPTIONAL:
114
115
If you receive an error regarding ruby version:
116
117
~~~~~~
118
brew install ruby@2.3
119
~~~~~~
120
121
may help.
122
123 1 Redmine Admin
124
## LaTeX ##
125
126
Those with sufficient hard drive space (3.4GB after install) may wish to download the full MacTeX package from <http://www.tug.org/mactex/downloading.html>. After installing, one can see the 'README ME FIRST.pdf' in /Applications/Tex. You will likely need to add /usr/texbin to your path:
127 29 John Cary
128
~~~~~~
129 1 Redmine Admin
setenv PATH /usr/texbin:${PATH}  # For tcsh
130 13 Redmine Admin
export PATH=/usr/texbin:${PATH}  # For bash
131 1 Redmine Admin
~~~~~~
132
133 13 Redmine Admin
For those who like GUIs, the !TeXworks in /Applications/TeX/TeXworks should work fine.
134
135
For those with limited space, install BasicTeX from <https://tug.org/mactex/morepackages.html>. Add to your PATH:
136 32 John Cary
137 13 Redmine Admin
~~~~~~
138
    /usr/local/texlive/2017/bin/universal-darwin/
139 32 John Cary
~~~~~~
140 1 Redmine Admin
141 32 John Cary
and then install the packages noted at
142 29 John Cary
143 32 John Cary
[[LaTeX packages needed by Bilder]]
144 1 Redmine Admin
145
You may need to use sudo.
146 32 John Cary
147
~~~~~~
148 1 Redmine Admin
sudo tlmgr update --self
149 29 John Cary
sudo tlmgr install <needed packages>
150 32 John Cary
~~~~~~
151
152 1 Redmine Admin
and then used the autoupdate feature to get any additionally needed packages.  This minimal installation is 230 M instead of the usual 2GB.
153
154
155
## Disable spindump ##
156
157
for faster compilations via
158
159 29 John Cary
~~~~~~
160 11 Redmine Admin
sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.spindump.plist
161 34 John Cary
~~~~~~
162
163
## LLVM-Clang ##
164
165 48 Nathan Neri
LLVM-Clang (aka LlvmClang) is different from AppleClang.  It has support for target attributes and openmp, and provides a build chain for high-performance computing.  Check out the llvm-project of your chosen version (Currently we are using the master branch (so no -b argument is needed), which is version 9.0.0):
166 1 Redmine Admin
167 48 Nathan Neri
~~~~~~
168
cd /opt
169
git clone -b <Release Branch> https://github.com/llvm/llvm-project.git llvm-<Version>
170
~~~~~~
171 1 Redmine Admin
172 48 Nathan Neri
To configure and build:
173
~~~~~~
174
cd /opt/llvm-<Version>
175
mkdir build
176
cd build
177
cmake ../llvm -DLLVM_ENABLE_PROJECTS="clang;openmp" -DLLVM_ENABLE_RTTI:BOOL=ON -DLLVM_ENABLE_EH:BOOL=ON -DCMAKE_INSTALL_PREFIX:PATH="/opt/llvm-<Version>/install" -G "Unix Makefiles"
178
make # Add appropriate -j argument for the machine to build faster - with -j 8 on qamojavellvm the build and installation took a little under an hour
179
make install
180
~~~~~~
181 1 Redmine Admin
182 48 Nathan Neri
Bilder will look in /opt/llvmclang/bin for llvm binaries (as well as $LLVM_DIR/bin, and your installation dir/bin, in case you need to keep multiple versions for different builds), so we set a link to the installation directory in the chosen version of llvm:
183 43 Tech-X Corporation
184 44 Tech-X Corporation
~~~~~~
185 43 Tech-X Corporation
cd /opt
186 48 Nathan Neri
sudo ln -s llvm-<Version>/install llvmclang
187 44 Tech-X Corporation
~~~~~~
188 43 Tech-X Corporation
189 11 Redmine Admin
## Java ##
190
191
You will need to install java by invoking the executable in any way such as...
192
193
~~~~~~
194
java -version
195 1 Redmine Admin
~~~~~~
196
197
Follow the instructions in the dialog that takes you to the Oracle website and choose the latest version to download.  (as of Nov 2015 this is 1.8)
198
199
## HostName ##
200 2 Redmine Admin
201 1 Redmine Admin
For bilder to properly send emails the fully qualified hostname must set on the machine. To check this try...
202 31 John Cary
203 29 John Cary
~~~~~~
204 1 Redmine Admin
hostname -f
205
~~~~~~
206
207
this should return machinename.domainname.com rather than just machinename.  If it does not, then set the hostname of the machine by typing the following commands.
208
209
~~~~~~
210
sudo scutil --set ComputerName "machinename"
211
sudo scutil --set LocalHostName "machinename"
212
sudo scutil --set HostName "machinename.domainname.com"
213
dscacheutil -flushcache
214
~~~~~~
215
216
Restart your Mac after this.
217
218
## Power Saving Modes ##
219
220
For build machines that are not personal machines, disabling certain options will help in connectivity and responsiveness:
221
222
~~~~~~
223
Under Spotlight
224
 - disabled the main HD. (multiple mdworkers taking up a lot of cpu.)
225
~~~~~~
226
227
~~~~~~
228
Under Energy Saver
229
 - Computer sleep: Set to never
230
 - Unchecked Put hard disks to sleep when possible
231
 - Unchecked Wake for network access
232
~~~~~~
233
234
&nbsp;
235
&nbsp;
236
&nbsp;
237
&nbsp;
238
&nbsp;
239
&nbsp;
240
&nbsp;
241
&nbsp;
242
&nbsp;
243 29 John Cary
&nbsp;
244
245
---
246
247 31 John Cary
---
248 1 Redmine Admin
249 31 John Cary
## X11 ##
250
251
X11 should not be needed, but if it is needed:
252
253
Install [XQuartz X11](http://xquartz.macosforge.org/landing/).
254
255
Create a symbolic link so that the X11 headers can be found by the compiler:
256
257
~~~~~~
258
sudo ln -s /opt/X11/include/X11 /usr/local/include/X11
259 1 Redmine Admin
~~~~~~
260 31 John Cary
261
# DEPRECATED INSTRUCTIONS #
262
263
264
## Other gfortran options (besides HomeBrew) ##
265
266
### Option 2: HPC ###
267
268
Install gfortran from [SourceForge HPC](http://hpc.sourceforge.net).  (Do not also install the other gcc compilers.)
269
270
As of March 29, 2015, the version is 4.9.0.
271
272
Install via
273
274
~~~~~~
275
$ tar xzf gfortran-4.9-bin.tar.gz -C /
276
~~~~~~
277
278
### Option 3: GNU ###
279
280
Install gfortran using the installer from <http://gcc.gnu.org/wiki/GFortranBinaries>.
281
282
As of March 29, 2015, the version is 4.9.0.
283
284 30 John Cary
The binaries will end up being installed in /usr/local/bin
285
286
287
## Git ##
288 11 Redmine Admin
289 1 Redmine Admin
If any repository package requires Git protocol, then for Lion and earlier you may need Git from <http://git-scm.com/download/mac> and add /usr/local/git/bin to your path.
290 10 Redmine Admin
291
292
### Macports ### 
293 11 Redmine Admin
294
This provides wget, freetype, and other utilities. Get macports from <http://www.macports.org/install.php> and install.
295
296 10 Redmine Admin
Note: Before proceeding with the installation of various macports packages noted below on Lion machines with Xcode 4.3, one needs to run
297 29 John Cary
298 10 Redmine Admin
~~~~~~
299
sudo xcode-select -switch /Applications/Xcode.app
300
~~~~~~
301 11 Redmine Admin
302
Otherwise, there will be an error installing zlib during the wget installation below.
303 1 Redmine Admin
304
After the macports installation, do
305 29 John Cary
306
~~~~~~
307
sudo port install wget
308 1 Redmine Admin
sudo port install ImageMagick +no_x11
309
sudo port install f2c
310
~~~~~~
311
312
313 11 Redmine Admin
### XCode ###
314 1 Redmine Admin
### Lion ###
315
316
On Lion, the command line compilers are not installed automatically. After installing Xcode, navigate to the 
317 2 Redmine Admin
Preferences->Download dialog 
318 1 Redmine Admin
and install the Command Line Tools. The dialog is.. 
319
320
!screenShotCommandLineTools.png!
321
322 11 Redmine Admin
or from the command line do
323 29 John Cary
324
~~~~~~
325 1 Redmine Admin
sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer/
326
xcodebuild
327
      (hit agree)
328
~~~~~~
329
330
You may subsequently need to build your first package with sudo in order to accept the Xcode licenses.
331
332
### Mountain Lion ### 
333
334
Same as Mavericks?
335
336 2 Redmine Admin
### Mavericks ###
337 29 John Cary
338 1 Redmine Admin
~~~~~~
339
sudo xcode-select --install
340
~~~~~~
341
342
343
## Java ##
344
345
(The below does not apply to yosemite.)
346
347
The cmake build may fail due to missing java headers linked to in /System/Library/Frameworks/JavaVM.framework/Headers. To fix:
348 29 John Cary
349
~~~~~~
350 1 Redmine Admin
cd /System/Library/Frameworks/JavaVM.framework/Headers
351
sudo mv jni.h jni.h.missing
352
~~~~~~