Project

General

Profile

Preparing a Mac machine for Bilder » History » Version 53

David Alexander, 04/01/2019 05:47 PM

1 2 Redmine Admin
# Preparing a Mac machine for Bilder #
2 1 Redmine Admin
3 24 John Cary
__If all you need is python and sphinx__ (e.g., for builds of documentation), then you need only
4
5
* XCode with command line tools
6
* Latex installed as noted below
7
8
and then you can add the arguments,  -W python, and your installed Python and CMake will be used if your path is correct.
9
10
11 2 Redmine Admin
## Bilder on Darwin ##
12 1 Redmine Admin
13 16 John Cary
Darwin comes with bash, so it is Bilder ready for the most part.
14 1 Redmine Admin
15 16 John Cary
### OS X Versions ###
16 1 Redmine Admin
17 16 John Cary
Yosemite's XCode that supports C++ 11 by default.
18 1 Redmine Admin
19 16 John Cary
El Capitan's clang compiler supports OpenMP.
20
21 1 Redmine Admin
## Case insensitive file system ##
22
23
We have noted and filed bugs for CMake errors on OS X when using the case-sensitive file system. To fix we use the case-insensitive file system. There may be problems with various packages and the case-insensitive file system.
24
25 2 Redmine Admin
## C and C++ compilers and Xcode command line tools ##
26 1 Redmine Admin
27
Install Xcode. To obtain version 6, visit https://developer.apple.com/xcode/download, then at the bottom third of the page, click on the "Additional Tools" link . Sign in with your Apple ID.  
28
29
~~~~~~
30 31 John Cary
sudo xcode-select --install
31 1 Redmine Admin
~~~~~~
32
33 35 John Cary
With mojave, one must additionally
34
35
~~~~~~
36
sudo installer -pkg /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg -target /
37
~~~~~~
38
39
But https://apple.stackexchange.com/questions/337940/why-is-usr-include-missing-i-have-xcode-and-command-line-tools-installed-moja says it is better to use `xcrun --show-sdk-path` to figure this out.
40
41 1 Redmine Admin
## HomeBrew ##
42
43
One must select a non-OSX package manager for some additional packages. The candidates are HomeBrew, MacPorts, and Fink, with the HomeBrew being our recommendation at this time, as it is active, and it has the philosophy of not building extraneous stuff that is already present on OSX, which MacPorts tends to do, thus using up more disk space.  HomeBrew also installs packages in their own subdirs with links to other places in /opt, thus making removal a matter removing a directory and then removing broken links in /opt/homebrew.
44
45 14 John Cary
HomeBrew requires that one not have root privileges.  So we make the directory into which we can write:
46 1 Redmine Admin
47
~~~~~~
48 29 John Cary
sudo -s
49
mkdir -p /opt/homebrew
50
chgrp -R admin /opt
51
chmod -R 775 /opt
52
chmod -R 2775 /opt/homebrew
53
exit
54 14 John Cary
~~~~~~
55
56
and then we work as nonroot:
57
58
~~~~~~
59 29 John Cary
cd /opt
60
curl -L https://github.com/Homebrew/brew/tarball/master | tar xz --strip 1 -C homebrew
61 39 David Alexander
~~~~~~
62
63
~~~~~~
64 29 John Cary
chmod -R a+rX /opt/homebrew
65 14 John Cary
find /opt/homebrew -type l -exec chmod -h a+r '{}' \;
66 1 Redmine Admin
~~~~~~
67
68 39 David Alexander
These last too lines can be reused at anytime there is a permissions problem.
69 1 Redmine Admin
70 39 David Alexander
As root again execute these lines to pick up some paths in the defaults paths:
71
72 1 Redmine Admin
~~~~~~
73 29 John Cary
sudo -s
74
echo "/opt/homebrew/bin" > /etc/paths.d/homebrew
75
echo "/opt/homebrew/share/man" > /etc/manpaths.d/homebrew
76
chmod a+r /etc/paths.d/homebrew /etc/manpaths.d/homebrew
77
exit
78 1 Redmine Admin
~~~~~~
79
80
Get the required packages...
81
82
~~~~~~
83 29 John Cary
brew install gnupg libpng freetype gd ghostscript
84 1 Redmine Admin
~~~~~~
85
86 16 John Cary
Nice to have:
87 1 Redmine Admin
88 16 John Cary
~~~~~~
89 29 John Cary
brew install imagemagick
90 16 John Cary
~~~~~~
91
92 45 Nathan Neri
git large file support (for VisIt)
93
94
~~~~~~
95
brew install git-lfs
96 47 Nathan Neri
git lfs install
97 45 Nathan Neri
~~~~~~
98
99 25 David Howdle
For Qt5:
100
101
~~~~~~
102
brew install bison flex gperf libcapn
103 1 Redmine Admin
~~~~~~
104 25 David Howdle
105 39 David Alexander
To get fortran, which comes with the gcc compiler:
106 1 Redmine Admin
107
~~~~~~
108 39 David Alexander
brew install gcc@6
109 1 Redmine Admin
~~~~~~
110
111 39 David Alexander
With versions older than gcc 6.5 (released Nov 2018) possibly needed for OSs older than Mojave, gfortran is not installed with gcc and you need to add the following argument "--with-fortran" to the above brew install command.
112 1 Redmine Admin
113 39 David Alexander
OPTIONAL:
114
115
If you receive an error regarding ruby version:
116
117
~~~~~~
118
brew install ruby@2.3
119
~~~~~~
120
121
may help.
122
123 1 Redmine Admin
124
## LaTeX ##
125
126
Those with sufficient hard drive space (3.4GB after install) may wish to download the full MacTeX package from <http://www.tug.org/mactex/downloading.html>. After installing, one can see the 'README ME FIRST.pdf' in /Applications/Tex. You will likely need to add /usr/texbin to your path:
127 29 John Cary
128
~~~~~~
129 1 Redmine Admin
setenv PATH /usr/texbin:${PATH}  # For tcsh
130 13 Redmine Admin
export PATH=/usr/texbin:${PATH}  # For bash
131 1 Redmine Admin
~~~~~~
132
133 13 Redmine Admin
For those who like GUIs, the !TeXworks in /Applications/TeX/TeXworks should work fine.
134
135
For those with limited space, install BasicTeX from <https://tug.org/mactex/morepackages.html>. Add to your PATH:
136 32 John Cary
137 13 Redmine Admin
~~~~~~
138
    /usr/local/texlive/2017/bin/universal-darwin/
139 32 John Cary
~~~~~~
140 1 Redmine Admin
141 32 John Cary
and then install the packages noted at
142 29 John Cary
143 32 John Cary
[[LaTeX packages needed by Bilder]]
144 1 Redmine Admin
145
You may need to use sudo.
146 32 John Cary
147
~~~~~~
148 1 Redmine Admin
sudo tlmgr update --self
149 29 John Cary
sudo tlmgr install <needed packages>
150 32 John Cary
~~~~~~
151
152 1 Redmine Admin
and then used the autoupdate feature to get any additionally needed packages.  This minimal installation is 230 M instead of the usual 2GB.
153
154
155
## Disable spindump ##
156
157
for faster compilations via
158
159 29 John Cary
~~~~~~
160 11 Redmine Admin
sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.spindump.plist
161 34 John Cary
~~~~~~
162
163
## LLVM-Clang ##
164
165 52 Nathan Neri
LLVM-Clang (aka LlvmClang) is different from AppleClang.  It has support for target attributes and openmp, and provides a build chain for high-performance computing.  Check out the llvm-project of your chosen version (Currently we are using the llvmorg-8.0.0 tag):
166 1 Redmine Admin
167 48 Nathan Neri
~~~~~~
168
cd /opt
169 53 David Alexander
# git clone -b <Branch> https://github.com/llvm/llvm-project.git llvm-<Version>
170
# You can see the branches you can clone at https://github.com/llvm/llvm-project
171
git clone -b llvmorg-8.0.0 https://github.com/llvm/llvm-project.git llvm-8.0.0
172 48 Nathan Neri
~~~~~~
173 1 Redmine Admin
174 48 Nathan Neri
To configure and build:
175 49 Nathan Neri
176 48 Nathan Neri
~~~~~~
177
cd /opt/llvm-<Version>
178 1 Redmine Admin
mkdir build
179 48 Nathan Neri
cd build
180 51 Nathan Neri
cmake ../llvm -DLLVM_ENABLE_PROJECTS="clang;openmp;libcxx;libcxxabi" -DLLVM_ENABLE_RTTI:BOOL=ON -DLLVM_ENABLE_EH:BOOL=ON -DCMAKE_INSTALL_PREFIX:PATH="/opt/llvm-<Version>/install" -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release
181 48 Nathan Neri
make # Add appropriate -j argument for the machine to build faster - with -j 8 on qamojavellvm the build and installation took a little under an hour
182
make install
183
~~~~~~
184 1 Redmine Admin
185 48 Nathan Neri
Bilder will look in /opt/llvmclang/bin for llvm binaries (as well as $LLVM_DIR/bin, and your installation dir/bin, in case you need to keep multiple versions for different builds), so we set a link to the installation directory in the chosen version of llvm:
186 43 Tech-X Corporation
187 44 Tech-X Corporation
~~~~~~
188 43 Tech-X Corporation
cd /opt
189 48 Nathan Neri
sudo ln -s llvm-<Version>/install llvmclang
190 44 Tech-X Corporation
~~~~~~
191 43 Tech-X Corporation
192 11 Redmine Admin
## Java ##
193
194
You will need to install java by invoking the executable in any way such as...
195
196
~~~~~~
197
java -version
198 1 Redmine Admin
~~~~~~
199
200
Follow the instructions in the dialog that takes you to the Oracle website and choose the latest version to download.  (as of Nov 2015 this is 1.8)
201
202
## HostName ##
203 2 Redmine Admin
204 1 Redmine Admin
For bilder to properly send emails the fully qualified hostname must set on the machine. To check this try...
205 31 John Cary
206 29 John Cary
~~~~~~
207 1 Redmine Admin
hostname -f
208
~~~~~~
209
210
this should return machinename.domainname.com rather than just machinename.  If it does not, then set the hostname of the machine by typing the following commands.
211
212
~~~~~~
213
sudo scutil --set ComputerName "machinename"
214
sudo scutil --set LocalHostName "machinename"
215
sudo scutil --set HostName "machinename.domainname.com"
216
dscacheutil -flushcache
217
~~~~~~
218
219
Restart your Mac after this.
220
221
## Power Saving Modes ##
222
223
For build machines that are not personal machines, disabling certain options will help in connectivity and responsiveness:
224
225
~~~~~~
226
Under Spotlight
227
 - disabled the main HD. (multiple mdworkers taking up a lot of cpu.)
228
~~~~~~
229
230
~~~~~~
231
Under Energy Saver
232
 - Computer sleep: Set to never
233
 - Unchecked Put hard disks to sleep when possible
234
 - Unchecked Wake for network access
235
~~~~~~
236
237
&nbsp;
238
&nbsp;
239
&nbsp;
240
&nbsp;
241
&nbsp;
242
&nbsp;
243
&nbsp;
244
&nbsp;
245
&nbsp;
246 29 John Cary
&nbsp;
247
248
---
249
250 31 John Cary
---
251 1 Redmine Admin
252 31 John Cary
## X11 ##
253
254
X11 should not be needed, but if it is needed:
255
256
Install [XQuartz X11](http://xquartz.macosforge.org/landing/).
257
258
Create a symbolic link so that the X11 headers can be found by the compiler:
259
260
~~~~~~
261
sudo ln -s /opt/X11/include/X11 /usr/local/include/X11
262 1 Redmine Admin
~~~~~~
263 31 John Cary
264
# DEPRECATED INSTRUCTIONS #
265
266
267
## Other gfortran options (besides HomeBrew) ##
268
269
### Option 2: HPC ###
270
271
Install gfortran from [SourceForge HPC](http://hpc.sourceforge.net).  (Do not also install the other gcc compilers.)
272
273
As of March 29, 2015, the version is 4.9.0.
274
275
Install via
276
277
~~~~~~
278
$ tar xzf gfortran-4.9-bin.tar.gz -C /
279
~~~~~~
280
281
### Option 3: GNU ###
282
283
Install gfortran using the installer from <http://gcc.gnu.org/wiki/GFortranBinaries>.
284
285
As of March 29, 2015, the version is 4.9.0.
286
287 30 John Cary
The binaries will end up being installed in /usr/local/bin
288
289
290
## Git ##
291 11 Redmine Admin
292 1 Redmine Admin
If any repository package requires Git protocol, then for Lion and earlier you may need Git from <http://git-scm.com/download/mac> and add /usr/local/git/bin to your path.
293 10 Redmine Admin
294
295
### Macports ### 
296 11 Redmine Admin
297
This provides wget, freetype, and other utilities. Get macports from <http://www.macports.org/install.php> and install.
298
299 10 Redmine Admin
Note: Before proceeding with the installation of various macports packages noted below on Lion machines with Xcode 4.3, one needs to run
300 29 John Cary
301 10 Redmine Admin
~~~~~~
302
sudo xcode-select -switch /Applications/Xcode.app
303
~~~~~~
304 11 Redmine Admin
305
Otherwise, there will be an error installing zlib during the wget installation below.
306 1 Redmine Admin
307
After the macports installation, do
308 29 John Cary
309
~~~~~~
310
sudo port install wget
311 1 Redmine Admin
sudo port install ImageMagick +no_x11
312
sudo port install f2c
313
~~~~~~
314
315
316 11 Redmine Admin
### XCode ###
317 1 Redmine Admin
### Lion ###
318
319
On Lion, the command line compilers are not installed automatically. After installing Xcode, navigate to the 
320 2 Redmine Admin
Preferences->Download dialog 
321 1 Redmine Admin
and install the Command Line Tools. The dialog is.. 
322
323
!screenShotCommandLineTools.png!
324
325 11 Redmine Admin
or from the command line do
326 29 John Cary
327
~~~~~~
328 1 Redmine Admin
sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer/
329
xcodebuild
330
      (hit agree)
331
~~~~~~
332
333
You may subsequently need to build your first package with sudo in order to accept the Xcode licenses.
334
335
### Mountain Lion ### 
336
337
Same as Mavericks?
338
339 2 Redmine Admin
### Mavericks ###
340 29 John Cary
341 1 Redmine Admin
~~~~~~
342
sudo xcode-select --install
343
~~~~~~
344
345
346
## Java ##
347
348
(The below does not apply to yosemite.)
349
350
The cmake build may fail due to missing java headers linked to in /System/Library/Frameworks/JavaVM.framework/Headers. To fix:
351 29 John Cary
352
~~~~~~
353 1 Redmine Admin
cd /System/Library/Frameworks/JavaVM.framework/Headers
354
sudo mv jni.h jni.h.missing
355
~~~~~~