Preparing a Mac machine for Bilder » History » Version 86
Scott Kruger, 06/17/2022 10:34 AM
1 | 2 | Redmine Admin | # Preparing a Mac machine for Bilder # |
---|---|---|---|
2 | 1 | Redmine Admin | |
3 | 70 | John Cary | *NOTE: as of Catalina, installing in /opt is no longer an option, so we have moved to /usr/local* |
4 | |||
5 | 24 | John Cary | __If all you need is python and sphinx__ (e.g., for builds of documentation), then you need only |
6 | |||
7 | * XCode with command line tools |
||
8 | * Latex installed as noted below |
||
9 | |||
10 | and then you can add the arguments, -W python, and your installed Python and CMake will be used if your path is correct. |
||
11 | |||
12 | |||
13 | 2 | Redmine Admin | ## Bilder on Darwin ## |
14 | 1 | Redmine Admin | |
15 | 16 | John Cary | Darwin comes with bash, so it is Bilder ready for the most part. |
16 | 1 | Redmine Admin | |
17 | 16 | John Cary | ### OS X Versions ### |
18 | 1 | Redmine Admin | |
19 | 16 | John Cary | Yosemite's XCode that supports C++ 11 by default. |
20 | 1 | Redmine Admin | |
21 | 16 | John Cary | El Capitan's clang compiler supports OpenMP. |
22 | |||
23 | 1 | Redmine Admin | ## Case insensitive file system ## |
24 | |||
25 | We have noted and filed bugs for CMake errors on OS X when using the case-sensitive file system. To fix we use the case-insensitive file system. There may be problems with various packages and the case-insensitive file system. |
||
26 | |||
27 | 2 | Redmine Admin | ## C and C++ compilers and Xcode command line tools ## |
28 | 1 | Redmine Admin | |
29 | 83 | David Alexander | Install Xcode. To obtain version 11.3 (11.x is required for LLVM@12), visit https://developer.apple.com/xcode/download, then at the bottom third of the page, click on the "Additional Tools" link . Sign in with your Apple ID. Also download the Command Line Tools to match the version of Xcode that you are getting. The Xcode.app directory that is unpacked by opening the .xip file should be moved to the /Applications/ folder. The Command Line Tools is a DMG that has a PKG installer, so just run that. One must additionally execute this command before using any command line tools: |
30 | 1 | Redmine Admin | |
31 | ~~~~~~ |
||
32 | 83 | David Alexander | sudo xcodebuild -license |
33 | 1 | Redmine Admin | ~~~~~~ |
34 | |||
35 | 83 | David Alexander | If you are upgrading from a previous installation you will want/need to run the following command |
36 | 35 | John Cary | |
37 | ~~~~~~ |
||
38 | 83 | David Alexander | sudo xcode-select -s /Applications/Xcode.app |
39 | 1 | Redmine Admin | ~~~~~~ |
40 | |||
41 | 83 | David Alexander | One can check the version of Xcode from the command-line with |
42 | 69 | John Cary | |
43 | 83 | David Alexander | ~~~~~ |
44 | xcodebuild -version |
||
45 | /usr/bin/clang --version |
||
46 | 69 | John Cary | ~~~~~~ |
47 | 65 | David Alexander | |
48 | 83 | David Alexander | The clang should be version 11.0.0 with Xcode 11.3.1. |
49 | 1 | Redmine Admin | |
50 | ## HomeBrew ## |
||
51 | 70 | John Cary | |
52 | 86 | Scott Kruger | One must select a non-OSX package manager for some additional packages. The candidates are HomeBrew, MacPorts, and Fink, with the HomeBrew being our recommendation at this time, as it is active, and it has the philosophy of not building extraneous stuff that is already present on OSX, which MacPorts tends to do, thus using up more disk space. HomeBrew also installs packages in their own subdirs with links to other places in `$HOMEBREWDIR` with $HOMEBREWDIR being either `/usr/local/homebrew` if on Intel Mac, or `/opt/homebrew` if on a Mac M1.. Thus removal of a package a matter removing a directory and then removing broken links in $HOMEBREWDIR. |
53 | 14 | John Cary | |
54 | 86 | Scott Kruger | To install homebrew, go to https://brew.sh and follow the installation directions. |
55 | 1 | Redmine Admin | |
56 | 82 | John Cary | Get various packages... |
57 | 16 | John Cary | |
58 | 82 | John Cary | ~~~~~~ |
59 | 86 | Scott Kruger | brew install subversion gnupg libpng freetype gd ghostscript ninja wget imagemagick bison flex gperf libcapn |
60 | 16 | John Cary | ~~~~~~ |
61 | 45 | Nathan Neri | |
62 | git large file support (for VisIt) |
||
63 | |||
64 | ~~~~~~ |
||
65 | 56 | Nathan Neri | brew install git-lfs |
66 | 39 | David Alexander | git lfs install --force --skip-smudge |
67 | 1 | Redmine Admin | ~~~~~~ |
68 | 79 | John Cary | |
69 | 75 | Tech-X Corporation | Fortran comes with the homebrew gcc compiler: |
70 | |||
71 | 81 | David Alexander | ~~~~~~ |
72 | 79 | John Cary | brew install gcc |
73 | 1 | Redmine Admin | ~~~~~~ |
74 | 39 | David Alexander | |
75 | OPTIONAL: |
||
76 | |||
77 | If you receive an error regarding ruby version: |
||
78 | |||
79 | ~~~~~~ |
||
80 | brew install ruby@2.3 |
||
81 | ~~~~~~ |
||
82 | |||
83 | may help. |
||
84 | 1 | Redmine Admin | |
85 | |||
86 | ## LaTeX ## |
||
87 | |||
88 | 29 | John Cary | Those with sufficient hard drive space (3.4GB after install) may wish to download the full MacTeX package from <http://www.tug.org/mactex/downloading.html>. After installing, one can see the 'README ME FIRST.pdf' in /Applications/Tex. You will likely need to add /usr/texbin to your path: |
89 | |||
90 | 1 | Redmine Admin | ~~~~~~ |
91 | 13 | Redmine Admin | setenv PATH /usr/texbin:${PATH} # For tcsh |
92 | 1 | Redmine Admin | export PATH=/usr/texbin:${PATH} # For bash |
93 | ~~~~~~ |
||
94 | 13 | Redmine Admin | |
95 | For those who like GUIs, the !TeXworks in /Applications/TeX/TeXworks should work fine. |
||
96 | |||
97 | 32 | John Cary | For those with limited space, install BasicTeX from <https://tug.org/mactex/morepackages.html>. Add to your PATH: |
98 | 13 | Redmine Admin | |
99 | ~~~~~~ |
||
100 | 32 | John Cary | /usr/local/texlive/2017/bin/universal-darwin/ |
101 | 1 | Redmine Admin | ~~~~~~ |
102 | 32 | John Cary | |
103 | 29 | John Cary | and then install the packages noted at |
104 | 32 | John Cary | |
105 | 1 | Redmine Admin | [[LaTeX packages needed by Bilder]] |
106 | |||
107 | 32 | John Cary | You may need to use sudo. |
108 | |||
109 | 1 | Redmine Admin | ~~~~~~ |
110 | 29 | John Cary | sudo tlmgr update --self |
111 | 32 | John Cary | sudo tlmgr install <needed packages> |
112 | ~~~~~~ |
||
113 | 1 | Redmine Admin | |
114 | and then used the autoupdate feature to get any additionally needed packages. This minimal installation is 230 M instead of the usual 2GB. |
||
115 | |||
116 | |||
117 | ## Disable spindump ## |
||
118 | |||
119 | for faster compilations via |
||
120 | |||
121 | ~~~~~~ |
||
122 | 58 | John Cary | sudo launchctl unload -w /System/Library/LaunchDaemons/com.apple.spindump.plist |
123 | ~~~~~~ |
||
124 | 67 | David Alexander | |
125 | 58 | John Cary | ## LLVM-Clang ## |
126 | |||
127 | LLVM-Clang (aka LlvmClang) is different from AppleClang. It has support for target attributes and openmp, and provides a build chain for high-performance computing. Check out the llvm-project of your chosen version. |
||
128 | |||
129 | We use homebrew to install this with |
||
130 | 61 | John Cary | |
131 | 71 | David Alexander | ~~~~~~ |
132 | 83 | David Alexander | brew install llvm@12 |
133 | 1 | Redmine Admin | ~~~~~~ |
134 | 78 | John Cary | |
135 | 85 | David Alexander | As of Feb 2022, the default llvm version is 13 and that would be probably fine, however 12 is tested and is known to be ok. Ensure that there is a link at /usr/local/homebrew/opt/llvm that points to the installation so bilder can properly find it. If not then do something like the following (this example is for version 12): |
136 | |||
137 | ~~~~~~ |
||
138 | cd /usr/local/homebrew/opt |
||
139 | ln -s ../Cellar/llvm\@12/12.0.1_1 llvm |
||
140 | ~~~~~~ |
||
141 | |||
142 | 78 | John Cary | |
143 | 1 | Redmine Admin | ALTERNATIVE |
144 | 78 | John Cary | |
145 | 1 | Redmine Admin | If brew does not work (e.g., it is not available for M1), then you can download a release from https://github.com/llvm/llvm-project/releases. |
146 | |||
147 | 48 | Nathan Neri | To configure and build: |
148 | 49 | Nathan Neri | |
149 | 80 | John Cary | ~~~~~~ |
150 | llvmver=12.0.0 # Correct as needed. |
||
151 | tar xf llvmorg-$llvmver.tar.gz |
||
152 | 1 | Redmine Admin | cd llvm-project-llvmorg-$llvmver |
153 | mkdir build |
||
154 | 80 | John Cary | cd build |
155 | 77 | John Cary | cmake ../llvm -DLLVM_ENABLE_PROJECTS="clang;openmp;libcxx;libcxxabi" -DLLVM_ENABLE_RTTI:BOOL=ON -DLLVM_ENABLE_EH:BOOL=ON -DCMAKE_INSTALL_PREFIX:PATH="/usr/local/opt/llvm-$llvmver/install" -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_NAME_DIR=/usr/local/opt/llvm-$llvmver/install/lib |
156 | 54 | David Alexander | make # Add appropriate -j argument for the machine to build faster |
157 | # with -j 8 on qamojavellvm the build and installation took a little under an hour |
||
158 | 48 | Nathan Neri | make install |
159 | ~~~~~~ |
||
160 | |||
161 | 43 | Tech-X Corporation | Bilder will look in /opt/llvmclang/bin for llvm binaries (as well as $LLVM_DIR/bin, and your installation dir/bin, in case you need to keep multiple versions for different builds), so we set a link to the installation directory in the chosen version of llvm: |
162 | 44 | Tech-X Corporation | |
163 | 78 | John Cary | ~~~~~~ |
164 | 48 | Nathan Neri | cd /usr/local/opt |
165 | 44 | Tech-X Corporation | sudo ln -s llvm-<Version>/install llvmclang |
166 | 43 | Tech-X Corporation | ~~~~~~ |
167 | 11 | Redmine Admin | |
168 | ## Java ## |
||
169 | |||
170 | You will need to install java by invoking the executable in any way such as... |
||
171 | |||
172 | ~~~~~~ |
||
173 | 1 | Redmine Admin | java -version |
174 | ~~~~~~ |
||
175 | 74 | Tech-X Corporation | |
176 | Follow the instructions in the dialog that takes you to the Oracle website and choose the latest version to download. (As of March 2021 this is 16.) |
||
177 | |||
178 | Chose the macOS installer from |
||
179 | 1 | Redmine Admin | https://www.oracle.com/java/technologies/javase-jdk16-downloads.html |
180 | |||
181 | 2 | Redmine Admin | ## HostName ## |
182 | 1 | Redmine Admin | |
183 | 31 | John Cary | For bilder to properly send emails the fully qualified hostname must set on the machine. To check this try... |
184 | 29 | John Cary | |
185 | 1 | Redmine Admin | ~~~~~~ |
186 | hostname -f |
||
187 | ~~~~~~ |
||
188 | |||
189 | this should return machinename.domainname.com rather than just machinename. If it does not, then set the hostname of the machine by typing the following commands. |
||
190 | |||
191 | ~~~~~~ |
||
192 | sudo scutil --set ComputerName "machinename" |
||
193 | sudo scutil --set LocalHostName "machinename" |
||
194 | sudo scutil --set HostName "machinename.domainname.com" |
||
195 | dscacheutil -flushcache |
||
196 | ~~~~~~ |
||
197 | |||
198 | Restart your Mac after this. |
||
199 | |||
200 | ## Power Saving Modes ## |
||
201 | |||
202 | For build machines that are not personal machines, disabling certain options will help in connectivity and responsiveness: |
||
203 | |||
204 | ~~~~~~ |
||
205 | Under Spotlight |
||
206 | - disabled the main HD. (multiple mdworkers taking up a lot of cpu.) |
||
207 | ~~~~~~ |
||
208 | |||
209 | ~~~~~~ |
||
210 | Under Energy Saver |
||
211 | - Computer sleep: Set to never |
||
212 | - Unchecked Put hard disks to sleep when possible |
||
213 | - Unchecked Wake for network access |
||
214 | ~~~~~~ |
||
215 | |||
216 | |
||
217 | |
||
218 | |
||
219 | |
||
220 | |
||
221 | |
||
222 | |
||
223 | |
||
224 | 29 | John Cary | |
225 | |
||
226 | |||
227 | --- |
||
228 | 31 | John Cary | |
229 | 1 | Redmine Admin | --- |
230 | 31 | John Cary | |
231 | ## X11 ## |
||
232 | |||
233 | X11 should not be needed, but if it is needed: |
||
234 | |||
235 | Install [XQuartz X11](http://xquartz.macosforge.org/landing/). |
||
236 | |||
237 | Create a symbolic link so that the X11 headers can be found by the compiler: |
||
238 | |||
239 | ~~~~~~ |
||
240 | 1 | Redmine Admin | sudo ln -s /opt/X11/include/X11 /usr/local/include/X11 |
241 | 31 | John Cary | ~~~~~~ |
242 | |||
243 | # DEPRECATED INSTRUCTIONS # |
||
244 | |||
245 | |||
246 | ## Other gfortran options (besides HomeBrew) ## |
||
247 | |||
248 | ### Option 2: HPC ### |
||
249 | |||
250 | Install gfortran from [SourceForge HPC](http://hpc.sourceforge.net). (Do not also install the other gcc compilers.) |
||
251 | |||
252 | As of March 29, 2015, the version is 4.9.0. |
||
253 | |||
254 | Install via |
||
255 | |||
256 | ~~~~~~ |
||
257 | $ tar xzf gfortran-4.9-bin.tar.gz -C / |
||
258 | ~~~~~~ |
||
259 | |||
260 | ### Option 3: GNU ### |
||
261 | |||
262 | Install gfortran using the installer from <http://gcc.gnu.org/wiki/GFortranBinaries>. |
||
263 | |||
264 | As of March 29, 2015, the version is 4.9.0. |
||
265 | 30 | John Cary | |
266 | The binaries will end up being installed in /usr/local/bin |
||
267 | |||
268 | |||
269 | 11 | Redmine Admin | ## Git ## |
270 | 1 | Redmine Admin | |
271 | 10 | Redmine Admin | If any repository package requires Git protocol, then for Lion and earlier you may need Git from <http://git-scm.com/download/mac> and add /usr/local/git/bin to your path. |
272 | |||
273 | |||
274 | 11 | Redmine Admin | ### Macports ### |
275 | |||
276 | This provides wget, freetype, and other utilities. Get macports from <http://www.macports.org/install.php> and install. |
||
277 | 10 | Redmine Admin | |
278 | 29 | John Cary | Note: Before proceeding with the installation of various macports packages noted below on Lion machines with Xcode 4.3, one needs to run |
279 | 10 | Redmine Admin | |
280 | ~~~~~~ |
||
281 | sudo xcode-select -switch /Applications/Xcode.app |
||
282 | 11 | Redmine Admin | ~~~~~~ |
283 | |||
284 | 1 | Redmine Admin | Otherwise, there will be an error installing zlib during the wget installation below. |
285 | |||
286 | 29 | John Cary | After the macports installation, do |
287 | |||
288 | ~~~~~~ |
||
289 | 1 | Redmine Admin | sudo port install wget |
290 | sudo port install ImageMagick +no_x11 |
||
291 | sudo port install f2c |
||
292 | ~~~~~~ |
||
293 | |||
294 | 11 | Redmine Admin | |
295 | 1 | Redmine Admin | ### XCode ### |
296 | ### Lion ### |
||
297 | |||
298 | 2 | Redmine Admin | On Lion, the command line compilers are not installed automatically. After installing Xcode, navigate to the |
299 | 1 | Redmine Admin | Preferences->Download dialog |
300 | and install the Command Line Tools. The dialog is.. |
||
301 | |||
302 | !screenShotCommandLineTools.png! |
||
303 | 11 | Redmine Admin | |
304 | 29 | John Cary | or from the command line do |
305 | |||
306 | 1 | Redmine Admin | ~~~~~~ |
307 | sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer/ |
||
308 | xcodebuild |
||
309 | (hit agree) |
||
310 | ~~~~~~ |
||
311 | |||
312 | You may subsequently need to build your first package with sudo in order to accept the Xcode licenses. |
||
313 | |||
314 | ### Mountain Lion ### |
||
315 | |||
316 | Same as Mavericks? |
||
317 | 2 | Redmine Admin | |
318 | 29 | John Cary | ### Mavericks ### |
319 | 1 | Redmine Admin | |
320 | ~~~~~~ |
||
321 | sudo xcode-select --install |
||
322 | ~~~~~~ |
||
323 | |||
324 | |||
325 | ## Java ## |
||
326 | |||
327 | (The below does not apply to yosemite.) |
||
328 | |||
329 | 29 | John Cary | The cmake build may fail due to missing java headers linked to in /System/Library/Frameworks/JavaVM.framework/Headers. To fix: |
330 | |||
331 | 1 | Redmine Admin | ~~~~~~ |
332 | cd /System/Library/Frameworks/JavaVM.framework/Headers |
||
333 | sudo mv jni.h jni.h.missing |
||
334 | ~~~~~~ |