Project

General

Profile

Preparing a Mac machine for Bilder » History » Version 93

David Alexander, 07/03/2023 04:00 PM

1 2 Redmine Admin
# Preparing a Mac machine for Bilder #
2 1 Redmine Admin
3 70 John Cary
*NOTE: as of Catalina, installing in /opt is no longer an option, so we have moved to /usr/local*
4
5 24 John Cary
__If all you need is python and sphinx__ (e.g., for builds of documentation), then you need only
6
7
* XCode with command line tools
8
* Latex installed as noted below
9
10
and then you can add the arguments,  -W python, and your installed Python and CMake will be used if your path is correct.
11
12
13 2 Redmine Admin
## Bilder on Darwin ##
14 1 Redmine Admin
15 16 John Cary
Darwin comes with bash, so it is Bilder ready for the most part.
16 1 Redmine Admin
17 16 John Cary
### OS X Versions ###
18 1 Redmine Admin
19 16 John Cary
Yosemite's XCode that supports C++ 11 by default.
20 1 Redmine Admin
21 16 John Cary
El Capitan's clang compiler supports OpenMP.
22
23 1 Redmine Admin
## Case insensitive file system ##
24
25
We have noted and filed bugs for CMake errors on OS X when using the case-sensitive file system. To fix we use the case-insensitive file system. There may be problems with various packages and the case-insensitive file system.
26
27 2 Redmine Admin
## C and C++ compilers and Xcode command line tools ##
28 1 Redmine Admin
29 83 David Alexander
Install Xcode. To obtain version 11.3 (11.x is required for LLVM@12), visit https://developer.apple.com/xcode/download, then at the bottom third of the page, click on the "Additional Tools" link . Sign in with your Apple ID. Also download the Command Line Tools to match the version of Xcode that you are getting. The Xcode.app directory that is unpacked by opening the .xip file should be moved to the /Applications/ folder. The Command Line Tools is a DMG that has a PKG installer, so just run that. One must additionally execute this command before using any command line tools:
30 1 Redmine Admin
31
~~~~~~
32 83 David Alexander
sudo xcodebuild -license
33 1 Redmine Admin
~~~~~~
34
35 83 David Alexander
If you are upgrading from a previous installation you will want/need to run the following command
36 35 John Cary
37
~~~~~~
38 83 David Alexander
sudo xcode-select -s /Applications/Xcode.app
39 1 Redmine Admin
~~~~~~
40
41 83 David Alexander
One can check the version of Xcode from the command-line with
42 69 John Cary
43 83 David Alexander
~~~~~
44
xcodebuild -version
45
/usr/bin/clang --version
46 69 John Cary
~~~~~~
47 65 David Alexander
48 83 David Alexander
The clang should be version 11.0.0 with Xcode 11.3.1.
49 1 Redmine Admin
50
## HomeBrew ##
51 70 John Cary
52 90 David Alexander
One must select a non-OSX package manager for some additional packages. The candidates are HomeBrew, MacPorts, and Fink, with the HomeBrew being our recommendation at this time, as it is active, and it has the philosophy of not building extraneous stuff that is already present on OSX, which MacPorts tends to do, thus using up more disk space.  HomeBrew also installs packages in their own subdirs with links to other places in `$HOMEBREWDIR` with $HOMEBREWDIR being either `/usr/local/homebrew` if on Intel Mac, or `/opt/homebrew` if on Apple ARM architecture (M1, M2, etc.).  Thus removal of a package a matter removing a directory and then removing broken links in $HOMEBREWDIR.
53 14 John Cary
54 86 Scott Kruger
To install homebrew, go to https://brew.sh  and follow the installation directions.
55 1 Redmine Admin
56 82 John Cary
Get various packages...
57 16 John Cary
58 82 John Cary
~~~~~~
59 86 Scott Kruger
brew install subversion gnupg libpng freetype gd ghostscript ninja wget imagemagick bison flex gperf libcapn
60 16 John Cary
~~~~~~
61 45 Nathan Neri
62
git large file support (for VisIt)
63
64
~~~~~~
65 56 Nathan Neri
brew install git-lfs
66 39 David Alexander
git lfs install --force --skip-smudge
67 1 Redmine Admin
~~~~~~
68 79 John Cary
69 92 David Alexander
Fortran comes with the homebrew gcc compiler. 
70 88 John Cary
71
~~~~~~
72 92 David Alexander
brew install gcc  # Intel architecture
73 88 John Cary
~~~~~~
74
75 90 David Alexander
On Apple ARM architecture gcc needs to be installed from source and there are some other packages to install
76 75 Tech-X Corporation
77 81 David Alexander
~~~~~~
78 92 David Alexander
brew install --build-from-source gcc   # ARM architecture
79
brew install qt@5  # ARM only. Version 5.15.10 as of 7/3/2023
80 1 Redmine Admin
~~~~~~
81 39 David Alexander
82
OPTIONAL:
83
84
If you receive an error regarding ruby version:
85
86
~~~~~~
87
brew install ruby@2.3
88
~~~~~~
89
90
may help.
91 1 Redmine Admin
92
93
## LaTeX ##
94
95 29 John Cary
Those with sufficient hard drive space (3.4GB after install) may wish to download the full MacTeX package from <http://www.tug.org/mactex/downloading.html>. After installing, one can see the 'README ME FIRST.pdf' in /Applications/Tex. You will likely need to add /usr/texbin to your path:
96
97 1 Redmine Admin
~~~~~~
98 13 Redmine Admin
setenv PATH /usr/texbin:${PATH}  # For tcsh
99 1 Redmine Admin
export PATH=/usr/texbin:${PATH}  # For bash
100
~~~~~~
101 13 Redmine Admin
102
For those who like GUIs, the !TeXworks in /Applications/TeX/TeXworks should work fine.
103
104 32 John Cary
For those with limited space, install BasicTeX from <https://tug.org/mactex/morepackages.html>. Add to your PATH:
105 13 Redmine Admin
106
~~~~~~
107 32 John Cary
    /usr/local/texlive/2017/bin/universal-darwin/
108 1 Redmine Admin
~~~~~~
109 32 John Cary
110 29 John Cary
and then install the packages noted at
111 32 John Cary
112 1 Redmine Admin
[[LaTeX packages needed by Bilder]]
113
114 32 John Cary
You may need to use sudo.
115
116 1 Redmine Admin
~~~~~~
117 29 John Cary
sudo tlmgr update --self
118 32 John Cary
sudo tlmgr install <needed packages>
119
~~~~~~
120 1 Redmine Admin
121
and then used the autoupdate feature to get any additionally needed packages.  This minimal installation is 230 M instead of the usual 2GB.
122
123
124
## Disable spindump ##
125
126
for faster compilations via
127
128
~~~~~~
129 58 John Cary
sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.spindump.plist
130
~~~~~~
131 67 David Alexander
132 93 David Alexander
## LLVM-Clang (Only on Intel Architecture) ##
133 58 John Cary
134
LLVM-Clang (aka LlvmClang) is different from AppleClang.  It has support for target attributes and openmp, and provides a build chain for high-performance computing.  Check out the llvm-project of your chosen version.
135
136
We use homebrew to install this with
137 61 John Cary
138 71 David Alexander
~~~~~~
139 83 David Alexander
brew install llvm@12
140 1 Redmine Admin
~~~~~~
141 78 John Cary
142 85 David Alexander
As of Feb 2022, the default llvm version is 13 and that would be probably fine, however 12 is tested and is known to be ok. Ensure that there is a link at /usr/local/homebrew/opt/llvm that points to the installation so bilder can properly find it. If not then do something like the following (this example is for version 12):
143
144
~~~~~~
145
cd /usr/local/homebrew/opt
146
ln -s ../Cellar/llvm\@12/12.0.1_1 llvm
147
~~~~~~
148
149 78 John Cary
150 1 Redmine Admin
ALTERNATIVE
151 78 John Cary
152 90 David Alexander
If brew does not work, then you can download a release from https://github.com/llvm/llvm-project/releases.
153 1 Redmine Admin
154 48 Nathan Neri
To configure and build:
155 49 Nathan Neri
156 80 John Cary
~~~~~~
157
llvmver=12.0.0 # Correct as needed.
158
tar xf llvmorg-$llvmver.tar.gz
159 1 Redmine Admin
cd llvm-project-llvmorg-$llvmver
160
mkdir build
161 80 John Cary
cd build
162 77 John Cary
cmake ../llvm -DLLVM_ENABLE_PROJECTS="clang;openmp;libcxx;libcxxabi" -DLLVM_ENABLE_RTTI:BOOL=ON -DLLVM_ENABLE_EH:BOOL=ON -DCMAKE_INSTALL_PREFIX:PATH="/usr/local/opt/llvm-$llvmver/install" -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_NAME_DIR=/usr/local/opt/llvm-$llvmver/install/lib
163 54 David Alexander
make # Add appropriate -j argument for the machine to build faster
164
          # with -j 8 on qamojavellvm the build and installation took a little under an hour
165 48 Nathan Neri
make install
166
~~~~~~
167
168 43 Tech-X Corporation
Bilder will look in /opt/llvmclang/bin for llvm binaries (as well as $LLVM_DIR/bin, and your installation dir/bin, in case you need to keep multiple versions for different builds), so we set a link to the installation directory in the chosen version of llvm:
169 44 Tech-X Corporation
170 78 John Cary
~~~~~~
171 48 Nathan Neri
cd /usr/local/opt
172 44 Tech-X Corporation
sudo ln -s llvm-<Version>/install llvmclang
173 43 Tech-X Corporation
~~~~~~
174 11 Redmine Admin
175
## Java ##
176
177
You will need to install java by invoking the executable in any way such as...
178
179
~~~~~~
180 1 Redmine Admin
java -version
181
~~~~~~
182 74 Tech-X Corporation
183
Follow the instructions in the dialog that takes you to the Oracle website and choose the latest version to download.  (As of March 2021 this is 16.)
184
185
Chose the macOS installer from
186 1 Redmine Admin
https://www.oracle.com/java/technologies/javase-jdk16-downloads.html
187
188 2 Redmine Admin
## HostName ##
189 1 Redmine Admin
190 31 John Cary
For bilder to properly send emails the fully qualified hostname must set on the machine. To check this try...
191 29 John Cary
192 1 Redmine Admin
~~~~~~
193
hostname -f
194
~~~~~~
195
196
this should return machinename.domainname.com rather than just machinename.  If it does not, then set the hostname of the machine by typing the following commands.
197
198
~~~~~~
199
sudo scutil --set ComputerName "machinename"
200
sudo scutil --set LocalHostName "machinename"
201
sudo scutil --set HostName "machinename.domainname.com"
202
dscacheutil -flushcache
203
~~~~~~
204
205
Restart your Mac after this.
206
207
## Power Saving Modes ##
208
209
For build machines that are not personal machines, disabling certain options will help in connectivity and responsiveness:
210
211
~~~~~~
212
Under Spotlight
213
 - disabled the main HD. (multiple mdworkers taking up a lot of cpu.)
214
~~~~~~
215
216
~~~~~~
217
Under Energy Saver
218
 - Computer sleep: Set to never
219
 - Unchecked Put hard disks to sleep when possible
220
 - Unchecked Wake for network access
221
~~~~~~
222
223
&nbsp;
224
&nbsp;
225
&nbsp;
226
&nbsp;
227
&nbsp;
228
&nbsp;
229
&nbsp;
230
&nbsp;
231 29 John Cary
&nbsp;
232
&nbsp;
233
234
---
235 31 John Cary
236 1 Redmine Admin
---
237 31 John Cary
238
## X11 ##
239
240
X11 should not be needed, but if it is needed:
241
242
Install [XQuartz X11](http://xquartz.macosforge.org/landing/).
243
244
Create a symbolic link so that the X11 headers can be found by the compiler:
245
246
~~~~~~
247 1 Redmine Admin
sudo ln -s /opt/X11/include/X11 /usr/local/include/X11
248 31 John Cary
~~~~~~
249
250
# DEPRECATED INSTRUCTIONS #
251
252
253
## Other gfortran options (besides HomeBrew) ##
254
255
### Option 2: HPC ###
256
257
Install gfortran from [SourceForge HPC](http://hpc.sourceforge.net).  (Do not also install the other gcc compilers.)
258
259
As of March 29, 2015, the version is 4.9.0.
260
261
Install via
262
263
~~~~~~
264
$ tar xzf gfortran-4.9-bin.tar.gz -C /
265
~~~~~~
266
267
### Option 3: GNU ###
268
269
Install gfortran using the installer from <http://gcc.gnu.org/wiki/GFortranBinaries>.
270
271
As of March 29, 2015, the version is 4.9.0.
272 30 John Cary
273
The binaries will end up being installed in /usr/local/bin
274
275
276 11 Redmine Admin
## Git ##
277 1 Redmine Admin
278 10 Redmine Admin
If any repository package requires Git protocol, then for Lion and earlier you may need Git from <http://git-scm.com/download/mac> and add /usr/local/git/bin to your path.
279
280
281 11 Redmine Admin
### Macports ### 
282
283
This provides wget, freetype, and other utilities. Get macports from <http://www.macports.org/install.php> and install.
284 10 Redmine Admin
285 29 John Cary
Note: Before proceeding with the installation of various macports packages noted below on Lion machines with Xcode 4.3, one needs to run
286 10 Redmine Admin
287
~~~~~~
288
sudo xcode-select -switch /Applications/Xcode.app
289 11 Redmine Admin
~~~~~~
290
291 1 Redmine Admin
Otherwise, there will be an error installing zlib during the wget installation below.
292
293 29 John Cary
After the macports installation, do
294
295
~~~~~~
296 1 Redmine Admin
sudo port install wget
297
sudo port install ImageMagick +no_x11
298
sudo port install f2c
299
~~~~~~
300
301 11 Redmine Admin
302 1 Redmine Admin
### XCode ###
303
### Lion ###
304
305 2 Redmine Admin
On Lion, the command line compilers are not installed automatically. After installing Xcode, navigate to the 
306 1 Redmine Admin
Preferences->Download dialog 
307
and install the Command Line Tools. The dialog is.. 
308
309
!screenShotCommandLineTools.png!
310 11 Redmine Admin
311 29 John Cary
or from the command line do
312
313 1 Redmine Admin
~~~~~~
314
sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer/
315
xcodebuild
316
      (hit agree)
317
~~~~~~
318
319
You may subsequently need to build your first package with sudo in order to accept the Xcode licenses.
320
321
### Mountain Lion ### 
322
323
Same as Mavericks?
324 2 Redmine Admin
325 29 John Cary
### Mavericks ###
326 1 Redmine Admin
327
~~~~~~
328
sudo xcode-select --install
329
~~~~~~
330
331
332
## Java ##
333
334
(The below does not apply to yosemite.)
335
336 29 John Cary
The cmake build may fail due to missing java headers linked to in /System/Library/Frameworks/JavaVM.framework/Headers. To fix:
337
338 1 Redmine Admin
~~~~~~
339
cd /System/Library/Frameworks/JavaVM.framework/Headers
340
sudo mv jni.h jni.h.missing
341
~~~~~~