Project

General

Profile

Preparing a Mac machine for Bilder » History » Version 51

Nathan Neri, 04/01/2019 11:20 AM
Clarifying some llvm installation instructions with work for faster installations.

1 2 Redmine Admin
# Preparing a Mac machine for Bilder #
2 1 Redmine Admin
3 24 John Cary
__If all you need is python and sphinx__ (e.g., for builds of documentation), then you need only
4
5
* XCode with command line tools
6
* Latex installed as noted below
7
8
and then you can add the arguments,  -W python, and your installed Python and CMake will be used if your path is correct.
9
10
11 2 Redmine Admin
## Bilder on Darwin ##
12 1 Redmine Admin
13 16 John Cary
Darwin comes with bash, so it is Bilder ready for the most part.
14 1 Redmine Admin
15 16 John Cary
### OS X Versions ###
16 1 Redmine Admin
17 16 John Cary
Yosemite's XCode that supports C++ 11 by default.
18 1 Redmine Admin
19 16 John Cary
El Capitan's clang compiler supports OpenMP.
20
21 1 Redmine Admin
## Case insensitive file system ##
22
23
We have noted and filed bugs for CMake errors on OS X when using the case-sensitive file system. To fix we use the case-insensitive file system. There may be problems with various packages and the case-insensitive file system.
24
25 2 Redmine Admin
## C and C++ compilers and Xcode command line tools ##
26 1 Redmine Admin
27
Install Xcode. To obtain version 6, visit https://developer.apple.com/xcode/download, then at the bottom third of the page, click on the "Additional Tools" link . Sign in with your Apple ID.  
28
29
~~~~~~
30 31 John Cary
sudo xcode-select --install
31 1 Redmine Admin
~~~~~~
32
33 35 John Cary
With mojave, one must additionally
34
35
~~~~~~
36
sudo installer -pkg /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg -target /
37
~~~~~~
38
39
But https://apple.stackexchange.com/questions/337940/why-is-usr-include-missing-i-have-xcode-and-command-line-tools-installed-moja says it is better to use `xcrun --show-sdk-path` to figure this out.
40
41 1 Redmine Admin
## HomeBrew ##
42
43
One must select a non-OSX package manager for some additional packages. The candidates are HomeBrew, MacPorts, and Fink, with the HomeBrew being our recommendation at this time, as it is active, and it has the philosophy of not building extraneous stuff that is already present on OSX, which MacPorts tends to do, thus using up more disk space.  HomeBrew also installs packages in their own subdirs with links to other places in /opt, thus making removal a matter removing a directory and then removing broken links in /opt/homebrew.
44
45 14 John Cary
HomeBrew requires that one not have root privileges.  So we make the directory into which we can write:
46 1 Redmine Admin
47
~~~~~~
48 29 John Cary
sudo -s
49
mkdir -p /opt/homebrew
50
chgrp -R admin /opt
51
chmod -R 775 /opt
52
chmod -R 2775 /opt/homebrew
53
exit
54 14 John Cary
~~~~~~
55
56
and then we work as nonroot:
57
58
~~~~~~
59 29 John Cary
cd /opt
60
curl -L https://github.com/Homebrew/brew/tarball/master | tar xz --strip 1 -C homebrew
61 39 David Alexander
~~~~~~
62
63
~~~~~~
64 29 John Cary
chmod -R a+rX /opt/homebrew
65 14 John Cary
find /opt/homebrew -type l -exec chmod -h a+r '{}' \;
66 1 Redmine Admin
~~~~~~
67
68 39 David Alexander
These last too lines can be reused at anytime there is a permissions problem.
69 1 Redmine Admin
70 39 David Alexander
As root again execute these lines to pick up some paths in the defaults paths:
71
72 1 Redmine Admin
~~~~~~
73 29 John Cary
sudo -s
74
echo "/opt/homebrew/bin" > /etc/paths.d/homebrew
75
echo "/opt/homebrew/share/man" > /etc/manpaths.d/homebrew
76
chmod a+r /etc/paths.d/homebrew /etc/manpaths.d/homebrew
77
exit
78 1 Redmine Admin
~~~~~~
79
80
Get the required packages...
81
82
~~~~~~
83 29 John Cary
brew install gnupg libpng freetype gd ghostscript
84 1 Redmine Admin
~~~~~~
85
86 16 John Cary
Nice to have:
87 1 Redmine Admin
88 16 John Cary
~~~~~~
89 29 John Cary
brew install imagemagick
90 16 John Cary
~~~~~~
91
92 45 Nathan Neri
git large file support (for VisIt)
93
94
~~~~~~
95
brew install git-lfs
96 47 Nathan Neri
git lfs install
97 45 Nathan Neri
~~~~~~
98
99 25 David Howdle
For Qt5:
100
101
~~~~~~
102
brew install bison flex gperf libcapn
103 1 Redmine Admin
~~~~~~
104 25 David Howdle
105 39 David Alexander
To get fortran, which comes with the gcc compiler:
106 1 Redmine Admin
107
~~~~~~
108 39 David Alexander
brew install gcc@6
109 1 Redmine Admin
~~~~~~
110
111 39 David Alexander
With versions older than gcc 6.5 (released Nov 2018) possibly needed for OSs older than Mojave, gfortran is not installed with gcc and you need to add the following argument "--with-fortran" to the above brew install command.
112 1 Redmine Admin
113 39 David Alexander
OPTIONAL:
114
115
If you receive an error regarding ruby version:
116
117
~~~~~~
118
brew install ruby@2.3
119
~~~~~~
120
121
may help.
122
123 1 Redmine Admin
124
## LaTeX ##
125
126
Those with sufficient hard drive space (3.4GB after install) may wish to download the full MacTeX package from <http://www.tug.org/mactex/downloading.html>. After installing, one can see the 'README ME FIRST.pdf' in /Applications/Tex. You will likely need to add /usr/texbin to your path:
127 29 John Cary
128
~~~~~~
129 1 Redmine Admin
setenv PATH /usr/texbin:${PATH}  # For tcsh
130 13 Redmine Admin
export PATH=/usr/texbin:${PATH}  # For bash
131 1 Redmine Admin
~~~~~~
132
133 13 Redmine Admin
For those who like GUIs, the !TeXworks in /Applications/TeX/TeXworks should work fine.
134
135
For those with limited space, install BasicTeX from <https://tug.org/mactex/morepackages.html>. Add to your PATH:
136 32 John Cary
137 13 Redmine Admin
~~~~~~
138
    /usr/local/texlive/2017/bin/universal-darwin/
139 32 John Cary
~~~~~~
140 1 Redmine Admin
141 32 John Cary
and then install the packages noted at
142 29 John Cary
143 32 John Cary
[[LaTeX packages needed by Bilder]]
144 1 Redmine Admin
145
You may need to use sudo.
146 32 John Cary
147
~~~~~~
148 1 Redmine Admin
sudo tlmgr update --self
149 29 John Cary
sudo tlmgr install <needed packages>
150 32 John Cary
~~~~~~
151
152 1 Redmine Admin
and then used the autoupdate feature to get any additionally needed packages.  This minimal installation is 230 M instead of the usual 2GB.
153
154
155
## Disable spindump ##
156
157
for faster compilations via
158
159 29 John Cary
~~~~~~
160 11 Redmine Admin
sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.spindump.plist
161 34 John Cary
~~~~~~
162
163
## LLVM-Clang ##
164
165 48 Nathan Neri
LLVM-Clang (aka LlvmClang) is different from AppleClang.  It has support for target attributes and openmp, and provides a build chain for high-performance computing.  Check out the llvm-project of your chosen version (Currently we are using the master branch (so no -b argument is needed), which is version 9.0.0):
166 1 Redmine Admin
167 48 Nathan Neri
~~~~~~
168
cd /opt
169 51 Nathan Neri
git clone -b <Branch> https://github.com/llvm/llvm-project.git llvm-<Version>
170
# You can see the branches you can clone at https://github.com/llvm/llvm-project - for instance, -b llvmorg-8.0.0 would check out the tag for the 8.0.0 version
171 48 Nathan Neri
~~~~~~
172 1 Redmine Admin
173 48 Nathan Neri
To configure and build:
174 49 Nathan Neri
175 48 Nathan Neri
~~~~~~
176
cd /opt/llvm-<Version>
177 1 Redmine Admin
mkdir build
178 48 Nathan Neri
cd build
179 51 Nathan Neri
cmake ../llvm -DLLVM_ENABLE_PROJECTS="clang;openmp;libcxx;libcxxabi" -DLLVM_ENABLE_RTTI:BOOL=ON -DLLVM_ENABLE_EH:BOOL=ON -DCMAKE_INSTALL_PREFIX:PATH="/opt/llvm-<Version>/install" -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release
180 48 Nathan Neri
make # Add appropriate -j argument for the machine to build faster - with -j 8 on qamojavellvm the build and installation took a little under an hour
181
make install
182
~~~~~~
183 1 Redmine Admin
184 48 Nathan Neri
Bilder will look in /opt/llvmclang/bin for llvm binaries (as well as $LLVM_DIR/bin, and your installation dir/bin, in case you need to keep multiple versions for different builds), so we set a link to the installation directory in the chosen version of llvm:
185 43 Tech-X Corporation
186 44 Tech-X Corporation
~~~~~~
187 43 Tech-X Corporation
cd /opt
188 48 Nathan Neri
sudo ln -s llvm-<Version>/install llvmclang
189 44 Tech-X Corporation
~~~~~~
190 43 Tech-X Corporation
191 11 Redmine Admin
## Java ##
192
193
You will need to install java by invoking the executable in any way such as...
194
195
~~~~~~
196
java -version
197 1 Redmine Admin
~~~~~~
198
199
Follow the instructions in the dialog that takes you to the Oracle website and choose the latest version to download.  (as of Nov 2015 this is 1.8)
200
201
## HostName ##
202 2 Redmine Admin
203 1 Redmine Admin
For bilder to properly send emails the fully qualified hostname must set on the machine. To check this try...
204 31 John Cary
205 29 John Cary
~~~~~~
206 1 Redmine Admin
hostname -f
207
~~~~~~
208
209
this should return machinename.domainname.com rather than just machinename.  If it does not, then set the hostname of the machine by typing the following commands.
210
211
~~~~~~
212
sudo scutil --set ComputerName "machinename"
213
sudo scutil --set LocalHostName "machinename"
214
sudo scutil --set HostName "machinename.domainname.com"
215
dscacheutil -flushcache
216
~~~~~~
217
218
Restart your Mac after this.
219
220
## Power Saving Modes ##
221
222
For build machines that are not personal machines, disabling certain options will help in connectivity and responsiveness:
223
224
~~~~~~
225
Under Spotlight
226
 - disabled the main HD. (multiple mdworkers taking up a lot of cpu.)
227
~~~~~~
228
229
~~~~~~
230
Under Energy Saver
231
 - Computer sleep: Set to never
232
 - Unchecked Put hard disks to sleep when possible
233
 - Unchecked Wake for network access
234
~~~~~~
235
236
&nbsp;
237
&nbsp;
238
&nbsp;
239
&nbsp;
240
&nbsp;
241
&nbsp;
242
&nbsp;
243
&nbsp;
244
&nbsp;
245 29 John Cary
&nbsp;
246
247
---
248
249 31 John Cary
---
250 1 Redmine Admin
251 31 John Cary
## X11 ##
252
253
X11 should not be needed, but if it is needed:
254
255
Install [XQuartz X11](http://xquartz.macosforge.org/landing/).
256
257
Create a symbolic link so that the X11 headers can be found by the compiler:
258
259
~~~~~~
260
sudo ln -s /opt/X11/include/X11 /usr/local/include/X11
261 1 Redmine Admin
~~~~~~
262 31 John Cary
263
# DEPRECATED INSTRUCTIONS #
264
265
266
## Other gfortran options (besides HomeBrew) ##
267
268
### Option 2: HPC ###
269
270
Install gfortran from [SourceForge HPC](http://hpc.sourceforge.net).  (Do not also install the other gcc compilers.)
271
272
As of March 29, 2015, the version is 4.9.0.
273
274
Install via
275
276
~~~~~~
277
$ tar xzf gfortran-4.9-bin.tar.gz -C /
278
~~~~~~
279
280
### Option 3: GNU ###
281
282
Install gfortran using the installer from <http://gcc.gnu.org/wiki/GFortranBinaries>.
283
284
As of March 29, 2015, the version is 4.9.0.
285
286 30 John Cary
The binaries will end up being installed in /usr/local/bin
287
288
289
## Git ##
290 11 Redmine Admin
291 1 Redmine Admin
If any repository package requires Git protocol, then for Lion and earlier you may need Git from <http://git-scm.com/download/mac> and add /usr/local/git/bin to your path.
292 10 Redmine Admin
293
294
### Macports ### 
295 11 Redmine Admin
296
This provides wget, freetype, and other utilities. Get macports from <http://www.macports.org/install.php> and install.
297
298 10 Redmine Admin
Note: Before proceeding with the installation of various macports packages noted below on Lion machines with Xcode 4.3, one needs to run
299 29 John Cary
300 10 Redmine Admin
~~~~~~
301
sudo xcode-select -switch /Applications/Xcode.app
302
~~~~~~
303 11 Redmine Admin
304
Otherwise, there will be an error installing zlib during the wget installation below.
305 1 Redmine Admin
306
After the macports installation, do
307 29 John Cary
308
~~~~~~
309
sudo port install wget
310 1 Redmine Admin
sudo port install ImageMagick +no_x11
311
sudo port install f2c
312
~~~~~~
313
314
315 11 Redmine Admin
### XCode ###
316 1 Redmine Admin
### Lion ###
317
318
On Lion, the command line compilers are not installed automatically. After installing Xcode, navigate to the 
319 2 Redmine Admin
Preferences->Download dialog 
320 1 Redmine Admin
and install the Command Line Tools. The dialog is.. 
321
322
!screenShotCommandLineTools.png!
323
324 11 Redmine Admin
or from the command line do
325 29 John Cary
326
~~~~~~
327 1 Redmine Admin
sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer/
328
xcodebuild
329
      (hit agree)
330
~~~~~~
331
332
You may subsequently need to build your first package with sudo in order to accept the Xcode licenses.
333
334
### Mountain Lion ### 
335
336
Same as Mavericks?
337
338 2 Redmine Admin
### Mavericks ###
339 29 John Cary
340 1 Redmine Admin
~~~~~~
341
sudo xcode-select --install
342
~~~~~~
343
344
345
## Java ##
346
347
(The below does not apply to yosemite.)
348
349
The cmake build may fail due to missing java headers linked to in /System/Library/Frameworks/JavaVM.framework/Headers. To fix:
350 29 John Cary
351
~~~~~~
352 1 Redmine Admin
cd /System/Library/Frameworks/JavaVM.framework/Headers
353
sudo mv jni.h jni.h.missing
354
~~~~~~