Project

General

Profile

Preparing a Mac machine for Bilder » History » Version 54

David Alexander, 04/01/2019 05:51 PM

1 2 Redmine Admin
# Preparing a Mac machine for Bilder #
2 1 Redmine Admin
3 24 John Cary
__If all you need is python and sphinx__ (e.g., for builds of documentation), then you need only
4
5
* XCode with command line tools
6
* Latex installed as noted below
7
8
and then you can add the arguments,  -W python, and your installed Python and CMake will be used if your path is correct.
9
10
11 2 Redmine Admin
## Bilder on Darwin ##
12 1 Redmine Admin
13 16 John Cary
Darwin comes with bash, so it is Bilder ready for the most part.
14 1 Redmine Admin
15 16 John Cary
### OS X Versions ###
16 1 Redmine Admin
17 16 John Cary
Yosemite's XCode that supports C++ 11 by default.
18 1 Redmine Admin
19 16 John Cary
El Capitan's clang compiler supports OpenMP.
20
21 1 Redmine Admin
## Case insensitive file system ##
22
23
We have noted and filed bugs for CMake errors on OS X when using the case-sensitive file system. To fix we use the case-insensitive file system. There may be problems with various packages and the case-insensitive file system.
24
25 2 Redmine Admin
## C and C++ compilers and Xcode command line tools ##
26 1 Redmine Admin
27
Install Xcode. To obtain version 6, visit https://developer.apple.com/xcode/download, then at the bottom third of the page, click on the "Additional Tools" link . Sign in with your Apple ID.  
28
29
~~~~~~
30 31 John Cary
sudo xcode-select --install
31 1 Redmine Admin
~~~~~~
32
33 35 John Cary
With mojave, one must additionally
34
35
~~~~~~
36
sudo installer -pkg /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg -target /
37
~~~~~~
38
39
But https://apple.stackexchange.com/questions/337940/why-is-usr-include-missing-i-have-xcode-and-command-line-tools-installed-moja says it is better to use `xcrun --show-sdk-path` to figure this out.
40
41 1 Redmine Admin
## HomeBrew ##
42
43
One must select a non-OSX package manager for some additional packages. The candidates are HomeBrew, MacPorts, and Fink, with the HomeBrew being our recommendation at this time, as it is active, and it has the philosophy of not building extraneous stuff that is already present on OSX, which MacPorts tends to do, thus using up more disk space.  HomeBrew also installs packages in their own subdirs with links to other places in /opt, thus making removal a matter removing a directory and then removing broken links in /opt/homebrew.
44
45 14 John Cary
HomeBrew requires that one not have root privileges.  So we make the directory into which we can write:
46 1 Redmine Admin
47
~~~~~~
48 29 John Cary
sudo -s
49
mkdir -p /opt/homebrew
50
chgrp -R admin /opt
51
chmod -R 775 /opt
52
chmod -R 2775 /opt/homebrew
53
exit
54 14 John Cary
~~~~~~
55
56
and then we work as nonroot:
57
58
~~~~~~
59 29 John Cary
cd /opt
60
curl -L https://github.com/Homebrew/brew/tarball/master | tar xz --strip 1 -C homebrew
61 39 David Alexander
~~~~~~
62
63
~~~~~~
64 29 John Cary
chmod -R a+rX /opt/homebrew
65 14 John Cary
find /opt/homebrew -type l -exec chmod -h a+r '{}' \;
66 1 Redmine Admin
~~~~~~
67
68 39 David Alexander
These last too lines can be reused at anytime there is a permissions problem.
69 1 Redmine Admin
70 39 David Alexander
As root again execute these lines to pick up some paths in the defaults paths:
71
72 1 Redmine Admin
~~~~~~
73 29 John Cary
sudo -s
74
echo "/opt/homebrew/bin" > /etc/paths.d/homebrew
75
echo "/opt/homebrew/share/man" > /etc/manpaths.d/homebrew
76
chmod a+r /etc/paths.d/homebrew /etc/manpaths.d/homebrew
77
exit
78 1 Redmine Admin
~~~~~~
79
80
Get the required packages...
81
82
~~~~~~
83 29 John Cary
brew install gnupg libpng freetype gd ghostscript
84 1 Redmine Admin
~~~~~~
85
86 16 John Cary
Nice to have:
87 1 Redmine Admin
88 16 John Cary
~~~~~~
89 29 John Cary
brew install imagemagick
90 16 John Cary
~~~~~~
91
92 45 Nathan Neri
git large file support (for VisIt)
93
94
~~~~~~
95
brew install git-lfs
96 47 Nathan Neri
git lfs install
97 45 Nathan Neri
~~~~~~
98
99 25 David Howdle
For Qt5:
100
101
~~~~~~
102
brew install bison flex gperf libcapn
103 1 Redmine Admin
~~~~~~
104 25 David Howdle
105 39 David Alexander
To get fortran, which comes with the gcc compiler:
106 1 Redmine Admin
107
~~~~~~
108 39 David Alexander
brew install gcc@6
109 1 Redmine Admin
~~~~~~
110
111 39 David Alexander
With versions older than gcc 6.5 (released Nov 2018) possibly needed for OSs older than Mojave, gfortran is not installed with gcc and you need to add the following argument "--with-fortran" to the above brew install command.
112 1 Redmine Admin
113 39 David Alexander
OPTIONAL:
114
115
If you receive an error regarding ruby version:
116
117
~~~~~~
118
brew install ruby@2.3
119
~~~~~~
120
121
may help.
122
123 1 Redmine Admin
124
## LaTeX ##
125
126
Those with sufficient hard drive space (3.4GB after install) may wish to download the full MacTeX package from <http://www.tug.org/mactex/downloading.html>. After installing, one can see the 'README ME FIRST.pdf' in /Applications/Tex. You will likely need to add /usr/texbin to your path:
127 29 John Cary
128
~~~~~~
129 1 Redmine Admin
setenv PATH /usr/texbin:${PATH}  # For tcsh
130 13 Redmine Admin
export PATH=/usr/texbin:${PATH}  # For bash
131 1 Redmine Admin
~~~~~~
132
133 13 Redmine Admin
For those who like GUIs, the !TeXworks in /Applications/TeX/TeXworks should work fine.
134
135
For those with limited space, install BasicTeX from <https://tug.org/mactex/morepackages.html>. Add to your PATH:
136 32 John Cary
137 13 Redmine Admin
~~~~~~
138
    /usr/local/texlive/2017/bin/universal-darwin/
139 32 John Cary
~~~~~~
140 1 Redmine Admin
141 32 John Cary
and then install the packages noted at
142 29 John Cary
143 32 John Cary
[[LaTeX packages needed by Bilder]]
144 1 Redmine Admin
145
You may need to use sudo.
146 32 John Cary
147
~~~~~~
148 1 Redmine Admin
sudo tlmgr update --self
149 29 John Cary
sudo tlmgr install <needed packages>
150 32 John Cary
~~~~~~
151
152 1 Redmine Admin
and then used the autoupdate feature to get any additionally needed packages.  This minimal installation is 230 M instead of the usual 2GB.
153
154
155
## Disable spindump ##
156
157
for faster compilations via
158
159 29 John Cary
~~~~~~
160 11 Redmine Admin
sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.spindump.plist
161 34 John Cary
~~~~~~
162
163
## LLVM-Clang ##
164
165 52 Nathan Neri
LLVM-Clang (aka LlvmClang) is different from AppleClang.  It has support for target attributes and openmp, and provides a build chain for high-performance computing.  Check out the llvm-project of your chosen version (Currently we are using the llvmorg-8.0.0 tag):
166 1 Redmine Admin
167 48 Nathan Neri
~~~~~~
168
cd /opt
169 54 David Alexander
git clone -b <Branch> https://github.com/llvm/llvm-project.git llvm-<Version>
170 53 David Alexander
# You can see the branches you can clone at https://github.com/llvm/llvm-project
171 54 David Alexander
# e.g.  git clone -b llvmorg-8.0.0 https://github.com/llvm/llvm-project.git llvm-8.0.0
172 48 Nathan Neri
~~~~~~
173 1 Redmine Admin
174 48 Nathan Neri
To configure and build:
175 49 Nathan Neri
176 48 Nathan Neri
~~~~~~
177
cd /opt/llvm-<Version>
178 1 Redmine Admin
mkdir build
179
cd build
180 54 David Alexander
cmake ../llvm \
181
   -DLLVM_ENABLE_PROJECTS="clang;openmp;libcxx;libcxxabi" \
182
   -DLLVM_ENABLE_RTTI:BOOL=ON \
183
   -DLLVM_ENABLE_EH:BOOL=ON \
184
   -DCMAKE_INSTALL_PREFIX:PATH="/opt/llvm-<Version>/install" \
185
   -G "Unix Makefiles" \
186
   -DCMAKE_BUILD_TYPE=Release
187
make # Add appropriate -j argument for the machine to build faster
188
          # with -j 8 on qamojavellvm the build and installation took a little under an hour
189 48 Nathan Neri
make install
190
~~~~~~
191 1 Redmine Admin
192 48 Nathan Neri
Bilder will look in /opt/llvmclang/bin for llvm binaries (as well as $LLVM_DIR/bin, and your installation dir/bin, in case you need to keep multiple versions for different builds), so we set a link to the installation directory in the chosen version of llvm:
193 43 Tech-X Corporation
194 44 Tech-X Corporation
~~~~~~
195 43 Tech-X Corporation
cd /opt
196 48 Nathan Neri
sudo ln -s llvm-<Version>/install llvmclang
197 44 Tech-X Corporation
~~~~~~
198 43 Tech-X Corporation
199 11 Redmine Admin
## Java ##
200
201
You will need to install java by invoking the executable in any way such as...
202
203
~~~~~~
204
java -version
205 1 Redmine Admin
~~~~~~
206
207
Follow the instructions in the dialog that takes you to the Oracle website and choose the latest version to download.  (as of Nov 2015 this is 1.8)
208
209
## HostName ##
210 2 Redmine Admin
211 1 Redmine Admin
For bilder to properly send emails the fully qualified hostname must set on the machine. To check this try...
212 31 John Cary
213 29 John Cary
~~~~~~
214 1 Redmine Admin
hostname -f
215
~~~~~~
216
217
this should return machinename.domainname.com rather than just machinename.  If it does not, then set the hostname of the machine by typing the following commands.
218
219
~~~~~~
220
sudo scutil --set ComputerName "machinename"
221
sudo scutil --set LocalHostName "machinename"
222
sudo scutil --set HostName "machinename.domainname.com"
223
dscacheutil -flushcache
224
~~~~~~
225
226
Restart your Mac after this.
227
228
## Power Saving Modes ##
229
230
For build machines that are not personal machines, disabling certain options will help in connectivity and responsiveness:
231
232
~~~~~~
233
Under Spotlight
234
 - disabled the main HD. (multiple mdworkers taking up a lot of cpu.)
235
~~~~~~
236
237
~~~~~~
238
Under Energy Saver
239
 - Computer sleep: Set to never
240
 - Unchecked Put hard disks to sleep when possible
241
 - Unchecked Wake for network access
242
~~~~~~
243
244
&nbsp;
245
&nbsp;
246
&nbsp;
247
&nbsp;
248
&nbsp;
249
&nbsp;
250
&nbsp;
251
&nbsp;
252
&nbsp;
253 29 John Cary
&nbsp;
254
255
---
256
257 31 John Cary
---
258 1 Redmine Admin
259 31 John Cary
## X11 ##
260
261
X11 should not be needed, but if it is needed:
262
263
Install [XQuartz X11](http://xquartz.macosforge.org/landing/).
264
265
Create a symbolic link so that the X11 headers can be found by the compiler:
266
267
~~~~~~
268
sudo ln -s /opt/X11/include/X11 /usr/local/include/X11
269 1 Redmine Admin
~~~~~~
270 31 John Cary
271
# DEPRECATED INSTRUCTIONS #
272
273
274
## Other gfortran options (besides HomeBrew) ##
275
276
### Option 2: HPC ###
277
278
Install gfortran from [SourceForge HPC](http://hpc.sourceforge.net).  (Do not also install the other gcc compilers.)
279
280
As of March 29, 2015, the version is 4.9.0.
281
282
Install via
283
284
~~~~~~
285
$ tar xzf gfortran-4.9-bin.tar.gz -C /
286
~~~~~~
287
288
### Option 3: GNU ###
289
290
Install gfortran using the installer from <http://gcc.gnu.org/wiki/GFortranBinaries>.
291
292
As of March 29, 2015, the version is 4.9.0.
293
294 30 John Cary
The binaries will end up being installed in /usr/local/bin
295
296
297
## Git ##
298 11 Redmine Admin
299 1 Redmine Admin
If any repository package requires Git protocol, then for Lion and earlier you may need Git from <http://git-scm.com/download/mac> and add /usr/local/git/bin to your path.
300 10 Redmine Admin
301
302
### Macports ### 
303 11 Redmine Admin
304
This provides wget, freetype, and other utilities. Get macports from <http://www.macports.org/install.php> and install.
305
306 10 Redmine Admin
Note: Before proceeding with the installation of various macports packages noted below on Lion machines with Xcode 4.3, one needs to run
307 29 John Cary
308 10 Redmine Admin
~~~~~~
309
sudo xcode-select -switch /Applications/Xcode.app
310
~~~~~~
311 11 Redmine Admin
312
Otherwise, there will be an error installing zlib during the wget installation below.
313 1 Redmine Admin
314
After the macports installation, do
315 29 John Cary
316
~~~~~~
317
sudo port install wget
318 1 Redmine Admin
sudo port install ImageMagick +no_x11
319
sudo port install f2c
320
~~~~~~
321
322
323 11 Redmine Admin
### XCode ###
324 1 Redmine Admin
### Lion ###
325
326
On Lion, the command line compilers are not installed automatically. After installing Xcode, navigate to the 
327 2 Redmine Admin
Preferences->Download dialog 
328 1 Redmine Admin
and install the Command Line Tools. The dialog is.. 
329
330
!screenShotCommandLineTools.png!
331
332 11 Redmine Admin
or from the command line do
333 29 John Cary
334
~~~~~~
335 1 Redmine Admin
sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer/
336
xcodebuild
337
      (hit agree)
338
~~~~~~
339
340
You may subsequently need to build your first package with sudo in order to accept the Xcode licenses.
341
342
### Mountain Lion ### 
343
344
Same as Mavericks?
345
346 2 Redmine Admin
### Mavericks ###
347 29 John Cary
348 1 Redmine Admin
~~~~~~
349
sudo xcode-select --install
350
~~~~~~
351
352
353
## Java ##
354
355
(The below does not apply to yosemite.)
356
357
The cmake build may fail due to missing java headers linked to in /System/Library/Frameworks/JavaVM.framework/Headers. To fix:
358 29 John Cary
359
~~~~~~
360 1 Redmine Admin
cd /System/Library/Frameworks/JavaVM.framework/Headers
361
sudo mv jni.h jni.h.missing
362
~~~~~~