Project

General

Profile

Preparing a Mac machine for Bilder » History » Version 50

Nathan Neri, 03/28/2019 12:50 PM
Adding projects libcxx and libcxxabi to clang configuration.

1 2 Redmine Admin
# Preparing a Mac machine for Bilder #
2 1 Redmine Admin
3 24 John Cary
__If all you need is python and sphinx__ (e.g., for builds of documentation), then you need only
4
5
* XCode with command line tools
6
* Latex installed as noted below
7
8
and then you can add the arguments,  -W python, and your installed Python and CMake will be used if your path is correct.
9
10
11 2 Redmine Admin
## Bilder on Darwin ##
12 1 Redmine Admin
13 16 John Cary
Darwin comes with bash, so it is Bilder ready for the most part.
14 1 Redmine Admin
15 16 John Cary
### OS X Versions ###
16 1 Redmine Admin
17 16 John Cary
Yosemite's XCode that supports C++ 11 by default.
18 1 Redmine Admin
19 16 John Cary
El Capitan's clang compiler supports OpenMP.
20
21 1 Redmine Admin
## Case insensitive file system ##
22
23
We have noted and filed bugs for CMake errors on OS X when using the case-sensitive file system. To fix we use the case-insensitive file system. There may be problems with various packages and the case-insensitive file system.
24
25 2 Redmine Admin
## C and C++ compilers and Xcode command line tools ##
26 1 Redmine Admin
27
Install Xcode. To obtain version 6, visit https://developer.apple.com/xcode/download, then at the bottom third of the page, click on the "Additional Tools" link . Sign in with your Apple ID.  
28
29
~~~~~~
30 31 John Cary
sudo xcode-select --install
31 1 Redmine Admin
~~~~~~
32
33 35 John Cary
With mojave, one must additionally
34
35
~~~~~~
36
sudo installer -pkg /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg -target /
37
~~~~~~
38
39
But https://apple.stackexchange.com/questions/337940/why-is-usr-include-missing-i-have-xcode-and-command-line-tools-installed-moja says it is better to use `xcrun --show-sdk-path` to figure this out.
40
41 1 Redmine Admin
## HomeBrew ##
42
43
One must select a non-OSX package manager for some additional packages. The candidates are HomeBrew, MacPorts, and Fink, with the HomeBrew being our recommendation at this time, as it is active, and it has the philosophy of not building extraneous stuff that is already present on OSX, which MacPorts tends to do, thus using up more disk space.  HomeBrew also installs packages in their own subdirs with links to other places in /opt, thus making removal a matter removing a directory and then removing broken links in /opt/homebrew.
44
45 14 John Cary
HomeBrew requires that one not have root privileges.  So we make the directory into which we can write:
46 1 Redmine Admin
47
~~~~~~
48 29 John Cary
sudo -s
49
mkdir -p /opt/homebrew
50
chgrp -R admin /opt
51
chmod -R 775 /opt
52
chmod -R 2775 /opt/homebrew
53
exit
54 14 John Cary
~~~~~~
55
56
and then we work as nonroot:
57
58
~~~~~~
59 29 John Cary
cd /opt
60
curl -L https://github.com/Homebrew/brew/tarball/master | tar xz --strip 1 -C homebrew
61 39 David Alexander
~~~~~~
62
63
~~~~~~
64 29 John Cary
chmod -R a+rX /opt/homebrew
65 14 John Cary
find /opt/homebrew -type l -exec chmod -h a+r '{}' \;
66 1 Redmine Admin
~~~~~~
67
68 39 David Alexander
These last too lines can be reused at anytime there is a permissions problem.
69 1 Redmine Admin
70 39 David Alexander
As root again execute these lines to pick up some paths in the defaults paths:
71
72 1 Redmine Admin
~~~~~~
73 29 John Cary
sudo -s
74
echo "/opt/homebrew/bin" > /etc/paths.d/homebrew
75
echo "/opt/homebrew/share/man" > /etc/manpaths.d/homebrew
76
chmod a+r /etc/paths.d/homebrew /etc/manpaths.d/homebrew
77
exit
78 1 Redmine Admin
~~~~~~
79
80
Get the required packages...
81
82
~~~~~~
83 29 John Cary
brew install gnupg libpng freetype gd ghostscript
84 1 Redmine Admin
~~~~~~
85
86 16 John Cary
Nice to have:
87 1 Redmine Admin
88 16 John Cary
~~~~~~
89 29 John Cary
brew install imagemagick
90 16 John Cary
~~~~~~
91
92 45 Nathan Neri
git large file support (for VisIt)
93
94
~~~~~~
95
brew install git-lfs
96 47 Nathan Neri
git lfs install
97 45 Nathan Neri
~~~~~~
98
99 25 David Howdle
For Qt5:
100
101
~~~~~~
102
brew install bison flex gperf libcapn
103 1 Redmine Admin
~~~~~~
104 25 David Howdle
105 39 David Alexander
To get fortran, which comes with the gcc compiler:
106 1 Redmine Admin
107
~~~~~~
108 39 David Alexander
brew install gcc@6
109 1 Redmine Admin
~~~~~~
110
111 39 David Alexander
With versions older than gcc 6.5 (released Nov 2018) possibly needed for OSs older than Mojave, gfortran is not installed with gcc and you need to add the following argument "--with-fortran" to the above brew install command.
112 1 Redmine Admin
113 39 David Alexander
OPTIONAL:
114
115
If you receive an error regarding ruby version:
116
117
~~~~~~
118
brew install ruby@2.3
119
~~~~~~
120
121
may help.
122
123 1 Redmine Admin
124
## LaTeX ##
125
126
Those with sufficient hard drive space (3.4GB after install) may wish to download the full MacTeX package from <http://www.tug.org/mactex/downloading.html>. After installing, one can see the 'README ME FIRST.pdf' in /Applications/Tex. You will likely need to add /usr/texbin to your path:
127 29 John Cary
128
~~~~~~
129 1 Redmine Admin
setenv PATH /usr/texbin:${PATH}  # For tcsh
130 13 Redmine Admin
export PATH=/usr/texbin:${PATH}  # For bash
131 1 Redmine Admin
~~~~~~
132
133 13 Redmine Admin
For those who like GUIs, the !TeXworks in /Applications/TeX/TeXworks should work fine.
134
135
For those with limited space, install BasicTeX from <https://tug.org/mactex/morepackages.html>. Add to your PATH:
136 32 John Cary
137 13 Redmine Admin
~~~~~~
138
    /usr/local/texlive/2017/bin/universal-darwin/
139 32 John Cary
~~~~~~
140 1 Redmine Admin
141 32 John Cary
and then install the packages noted at
142 29 John Cary
143 32 John Cary
[[LaTeX packages needed by Bilder]]
144 1 Redmine Admin
145
You may need to use sudo.
146 32 John Cary
147
~~~~~~
148 1 Redmine Admin
sudo tlmgr update --self
149 29 John Cary
sudo tlmgr install <needed packages>
150 32 John Cary
~~~~~~
151
152 1 Redmine Admin
and then used the autoupdate feature to get any additionally needed packages.  This minimal installation is 230 M instead of the usual 2GB.
153
154
155
## Disable spindump ##
156
157
for faster compilations via
158
159 29 John Cary
~~~~~~
160 11 Redmine Admin
sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.spindump.plist
161 34 John Cary
~~~~~~
162
163
## LLVM-Clang ##
164
165 48 Nathan Neri
LLVM-Clang (aka LlvmClang) is different from AppleClang.  It has support for target attributes and openmp, and provides a build chain for high-performance computing.  Check out the llvm-project of your chosen version (Currently we are using the master branch (so no -b argument is needed), which is version 9.0.0):
166 1 Redmine Admin
167 48 Nathan Neri
~~~~~~
168
cd /opt
169
git clone -b <Release Branch> https://github.com/llvm/llvm-project.git llvm-<Version>
170
~~~~~~
171 1 Redmine Admin
172 48 Nathan Neri
To configure and build:
173 49 Nathan Neri
174 48 Nathan Neri
~~~~~~
175
cd /opt/llvm-<Version>
176
mkdir build
177
cd build
178 50 Nathan Neri
cmake ../llvm -DLLVM_ENABLE_PROJECTS="clang;openmp;libcxx;libcxxabi" -DLLVM_ENABLE_RTTI:BOOL=ON -DLLVM_ENABLE_EH:BOOL=ON -DCMAKE_INSTALL_PREFIX:PATH="/opt/llvm-<Version>/install" -G "Unix Makefiles"
179 48 Nathan Neri
make # Add appropriate -j argument for the machine to build faster - with -j 8 on qamojavellvm the build and installation took a little under an hour
180
make install
181
~~~~~~
182 1 Redmine Admin
183 48 Nathan Neri
Bilder will look in /opt/llvmclang/bin for llvm binaries (as well as $LLVM_DIR/bin, and your installation dir/bin, in case you need to keep multiple versions for different builds), so we set a link to the installation directory in the chosen version of llvm:
184 43 Tech-X Corporation
185 44 Tech-X Corporation
~~~~~~
186 43 Tech-X Corporation
cd /opt
187 48 Nathan Neri
sudo ln -s llvm-<Version>/install llvmclang
188 44 Tech-X Corporation
~~~~~~
189 43 Tech-X Corporation
190 11 Redmine Admin
## Java ##
191
192
You will need to install java by invoking the executable in any way such as...
193
194
~~~~~~
195
java -version
196 1 Redmine Admin
~~~~~~
197
198
Follow the instructions in the dialog that takes you to the Oracle website and choose the latest version to download.  (as of Nov 2015 this is 1.8)
199
200
## HostName ##
201 2 Redmine Admin
202 1 Redmine Admin
For bilder to properly send emails the fully qualified hostname must set on the machine. To check this try...
203 31 John Cary
204 29 John Cary
~~~~~~
205 1 Redmine Admin
hostname -f
206
~~~~~~
207
208
this should return machinename.domainname.com rather than just machinename.  If it does not, then set the hostname of the machine by typing the following commands.
209
210
~~~~~~
211
sudo scutil --set ComputerName "machinename"
212
sudo scutil --set LocalHostName "machinename"
213
sudo scutil --set HostName "machinename.domainname.com"
214
dscacheutil -flushcache
215
~~~~~~
216
217
Restart your Mac after this.
218
219
## Power Saving Modes ##
220
221
For build machines that are not personal machines, disabling certain options will help in connectivity and responsiveness:
222
223
~~~~~~
224
Under Spotlight
225
 - disabled the main HD. (multiple mdworkers taking up a lot of cpu.)
226
~~~~~~
227
228
~~~~~~
229
Under Energy Saver
230
 - Computer sleep: Set to never
231
 - Unchecked Put hard disks to sleep when possible
232
 - Unchecked Wake for network access
233
~~~~~~
234
235
&nbsp;
236
&nbsp;
237
&nbsp;
238
&nbsp;
239
&nbsp;
240
&nbsp;
241
&nbsp;
242
&nbsp;
243
&nbsp;
244 29 John Cary
&nbsp;
245
246
---
247
248 31 John Cary
---
249 1 Redmine Admin
250 31 John Cary
## X11 ##
251
252
X11 should not be needed, but if it is needed:
253
254
Install [XQuartz X11](http://xquartz.macosforge.org/landing/).
255
256
Create a symbolic link so that the X11 headers can be found by the compiler:
257
258
~~~~~~
259
sudo ln -s /opt/X11/include/X11 /usr/local/include/X11
260 1 Redmine Admin
~~~~~~
261 31 John Cary
262
# DEPRECATED INSTRUCTIONS #
263
264
265
## Other gfortran options (besides HomeBrew) ##
266
267
### Option 2: HPC ###
268
269
Install gfortran from [SourceForge HPC](http://hpc.sourceforge.net).  (Do not also install the other gcc compilers.)
270
271
As of March 29, 2015, the version is 4.9.0.
272
273
Install via
274
275
~~~~~~
276
$ tar xzf gfortran-4.9-bin.tar.gz -C /
277
~~~~~~
278
279
### Option 3: GNU ###
280
281
Install gfortran using the installer from <http://gcc.gnu.org/wiki/GFortranBinaries>.
282
283
As of March 29, 2015, the version is 4.9.0.
284
285 30 John Cary
The binaries will end up being installed in /usr/local/bin
286
287
288
## Git ##
289 11 Redmine Admin
290 1 Redmine Admin
If any repository package requires Git protocol, then for Lion and earlier you may need Git from <http://git-scm.com/download/mac> and add /usr/local/git/bin to your path.
291 10 Redmine Admin
292
293
### Macports ### 
294 11 Redmine Admin
295
This provides wget, freetype, and other utilities. Get macports from <http://www.macports.org/install.php> and install.
296
297 10 Redmine Admin
Note: Before proceeding with the installation of various macports packages noted below on Lion machines with Xcode 4.3, one needs to run
298 29 John Cary
299 10 Redmine Admin
~~~~~~
300
sudo xcode-select -switch /Applications/Xcode.app
301
~~~~~~
302 11 Redmine Admin
303
Otherwise, there will be an error installing zlib during the wget installation below.
304 1 Redmine Admin
305
After the macports installation, do
306 29 John Cary
307
~~~~~~
308
sudo port install wget
309 1 Redmine Admin
sudo port install ImageMagick +no_x11
310
sudo port install f2c
311
~~~~~~
312
313
314 11 Redmine Admin
### XCode ###
315 1 Redmine Admin
### Lion ###
316
317
On Lion, the command line compilers are not installed automatically. After installing Xcode, navigate to the 
318 2 Redmine Admin
Preferences->Download dialog 
319 1 Redmine Admin
and install the Command Line Tools. The dialog is.. 
320
321
!screenShotCommandLineTools.png!
322
323 11 Redmine Admin
or from the command line do
324 29 John Cary
325
~~~~~~
326 1 Redmine Admin
sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer/
327
xcodebuild
328
      (hit agree)
329
~~~~~~
330
331
You may subsequently need to build your first package with sudo in order to accept the Xcode licenses.
332
333
### Mountain Lion ### 
334
335
Same as Mavericks?
336
337 2 Redmine Admin
### Mavericks ###
338 29 John Cary
339 1 Redmine Admin
~~~~~~
340
sudo xcode-select --install
341
~~~~~~
342
343
344
## Java ##
345
346
(The below does not apply to yosemite.)
347
348
The cmake build may fail due to missing java headers linked to in /System/Library/Frameworks/JavaVM.framework/Headers. To fix:
349 29 John Cary
350
~~~~~~
351 1 Redmine Admin
cd /System/Library/Frameworks/JavaVM.framework/Headers
352
sudo mv jni.h jni.h.missing
353
~~~~~~