Preparing a Windows machine for Bilder » History » Version 84
John Cary, 02/17/2018 11:00 AM
1 | 1 | Redmine Admin | # Preparing a Windows machine for Bilder (64-bit only) |
---|---|---|---|
2 | |||
3 | 39 | Ted Sume | For building on Windows 10 in Ubuntu, follow the Linux Bilder setup instructions. |
4 | |||
5 | 22 | Matt Copper | Windows 7/2008: For 64-bit systems, 64-bit applications are stored in C:\Program Files and 32-bit applications are stored in C:\Program Files (x86). UserAccountControlSettings can be fine-tuned (see Control-Panel, System and Security, Action Center). Set Control Setting to the lowest setting (never notify) to avoid unwanted dialog boxes. This requires a reboot to take effect! At least for ATLAS, the UAC Settings must be adjusted to "never notify" (this action is generally recommended while taking all the steps below). |
6 | 1 | Redmine Admin | |
7 | # Basic Windows Configuration |
||
8 | |||
9 | _Warning:_ In following the directions below, pre-defined env variables like CL, PETSC_DIR, PETSC_ARCH, and others will cause problems. For example, one user had CL=/nologo which prevented the version and other info from being printed and caused bilder to fail. |
||
10 | |||
11 | # Editing your system path on Windows |
||
12 | |||
13 | From the Start menu, right click on My Computer and choose Properties. Choose the Advanced Tab, and click the Environment Variables button towards the bottom of the dialog. In System Variables, highlight Path and click Edit. This is where you make changes to your system path. |
||
14 | |||
15 | # Ensure that Windows knows its domainname |
||
16 | |||
17 | * From a command prompt, type the command: |
||
18 | |||
19 | ~~~~~~ |
||
20 | ipconfig /all |
||
21 | ~~~~~~ |
||
22 | |||
23 | Look for value of the "Primary Dns Suffix" field, which should be your domain name (i.e. txcorp.com). |
||
24 | |||
25 | * If cygwin is already installed, |
||
26 | |||
27 | ~~~~~~ |
||
28 | ipconfig /all | grep -i "Primary Dns Suffix" | sed -e 's/^.*: //' |
||
29 | ~~~~~~ |
||
30 | |||
31 | should return the domainname. This only applies if it is part of a Windows Domain. |
||
32 | |||
33 | * For Windows 7/Windows 2008 machines that are not a member of the Windows Domain, Active Directory, do the following: |
||
34 | 1. Right click on My Computer, select properties |
||
35 | 2. Click on Advanced system settings |
||
36 | 3. Select the computer name tab |
||
37 | 4. Click the change button |
||
38 | 5. Click the more button |
||
39 | 6. Enter the Primary DNS suffix. i.e. txcorp.com |
||
40 | |||
41 | # Create initial directories |
||
42 | |||
43 | * Create the folder C:\\bin (if not already present). |
||
44 | * Add or move C:\\bin to the front of your system path. |
||
45 | |||
46 | 74 | David Alexander | # What is "Required" for Bilder |
47 | 1 | Redmine Admin | |
48 | 74 | David Alexander | What is absolutely required for Bilder depends on what you are trying to build. For example, if you are **only building user documentation**, then you only need |
49 | 37 | John Cary | |
50 | 74 | David Alexander | * Blat (for emailing yourself) |
51 | 36 | John Cary | * Cygwin (for bash shell) |
52 | 1 | Redmine Admin | * CMake from an installer |
53 | 38 | John Cary | * Python from an installer |
54 | * Latex (MikTek below) |
||
55 | 1 | Redmine Admin | * Visual Studio Express (for nmake) |
56 | 36 | John Cary | |
57 | 1 | Redmine Admin | and then you can add the arguments, -W python,cmake, and your installed Python and CMake will be used if your path is correct. |
58 | |||
59 | 82 | John Cary | If you are building through Qt5, |
60 | |||
61 | * 2017-15.4.5 (the particular revision for building QtWebEngine). If not building Qt5, but using it, then at least need VS2015 or VS2017. |
||
62 | * Windows 10 or Windows 10 SDK |
||
63 | |||
64 | 83 | John Cary | Unfortunately, VS2015 and later have a different way have handling certain functions, as discussed at https://stackoverflow.com/questions/30412951/unresolved-external-symbol-imp-fprintf-and-imp-iob-func-sdl2, and so one has to build many packages, such as OpenSSL. |
65 | |||
66 | |||
67 | 74 | David Alexander | Below is a list of the Tools and Libraries that are most often needed. |
68 | |||
69 | # Tools (Required for most common builds within Bilder) |
||
70 | |||
71 | 1 | Redmine Admin | ## Blat |
72 | |||
73 | 74 | David Alexander | *Blat is a sendmail client for Windows needed to send emails.* |
74 | 1 | Redmine Admin | |
75 | * Download Blat from [The Blat SourceForge](http://sourceforge.net/projects/blat) Site and extract all files. As of 07/18/2013, this is version 311. |
||
76 | * Extract the blat311 folder into C:\\bin. |
||
77 | * Copy the C:\bin\blat311\full\blat.{exe,dll} to C:\bin\blat.{exe,dll} |
||
78 | * Execute the following command in a cygwin terminal |
||
79 | |||
80 | ~~~~~~ |
||
81 | blat -install mail.txcorp.com <username>@txcorp.com |
||
82 | ~~~~~~ |
||
83 | |||
84 | ## CMake |
||
85 | |||
86 | 74 | David Alexander | *CMake is a cross-platform build system needed to configure many of necessary packages.* |
87 | 1 | Redmine Admin | |
88 | * Install [CMake (a 32-bit application)](http://www.cmake.org/files/). |
||
89 | 80 | David Alexander | * Version 3.1 or higher is required. Picking a later version is better because it will allow bilder to build future versions of cmake. |
90 | 26 | John Cary | * Add the CMake path to the front of the system path! (Needed to build newer 64 bit versions through Bilder) |
91 | 1 | Redmine Admin | * When this step is complete, make sure the newest CMake is the only one in your system path. |
92 | |||
93 | 10 | Redmine Admin | ## CYGWIN |
94 | 1 | Redmine Admin | |
95 | 74 | David Alexander | *Cygwin is a Unix shell program for Windows and is needed to run the bash code of Bilder.* |
96 | |||
97 | 1 | Redmine Admin | ### Gotchas (in advance) |
98 | |||
99 | * Do not install Cygwin's MinGW. Those are installed in a separate area to reduce conflicts. |
||
100 | * Do not install Cygwin's rc, or you may get a weird error (/focmTryCompileExec.exe.embed.manifest.res: No such file or directory) about cl being invalid. This can be seen by the output of 'which rc'. |
||
101 | * Do not install Cygwin's mt. If 'which mt' returns /bin/mt or /usr/bin/mt, then move this aside too. |
||
102 | 11 | Redmine Admin | * If 'which link' returns /usr/bin/link, then move this aside (mv /usr/bin/link.exe /usr/bin/linkoff.exe) so that it is not picked up to replace the Visual Studio link. (This is where we could define BILDER_LINK.) |
103 | 1 | Redmine Admin | * Make sure that 'which find' returns the cygwin version (/usr/bin/find), not the Windows version. |
104 | * Make sure 'which cmd' returns the Windows version. If not, check that your bash_profile has not made an error in setting your path. |
||
105 | * If you get an error like "ValueError: Symbol table not found" when building numpy, you are somehow using a 32-bit version of objdump. Disable the 32-bit version. |
||
106 | |||
107 | ### Updating Cygwin |
||
108 | |||
109 | * Be sure to select the version of subversion that is compatible with any other sister machines being run through jenkins. They must all use the same version of svn, which must be the same version chosen in Jenkins. |
||
110 | * If you have moved aside any of the interfering commands (e.g. link, mt, rc) in the past and have recently updated cygwin or Windows, then do the 'which' checks again. |
||
111 | * Recreate the /etc/passwd and /etc/group file again using the mkpasswd and mkgroup commands described in the Configuring Cygwin section. |
||
112 | * Install Cygwin from [here](http://cygwin.com/install.html). There are now separate installers for 64 bit (setup-x86_64.exe ) and 32 bit (setup-x86.exe). |
||
113 | * Upon running setup-*.exe, select the packages: |
||
114 | 3 | Redmine Admin | * Base -> util-linux |
115 | * Devel -> bison |
||
116 | * Devel -> flex |
||
117 | 4 | Redmine Admin | * Devel -> gcc-g++ and gcc-fortran (4.9.3 does not compile sqlite, so choose 4.9.2) |
118 | 3 | Redmine Admin | * Devel -> git |
119 | * Devel -> make |
||
120 | * Devel -> mercurial |
||
121 | 1 | Redmine Admin | * Devel -> patch |
122 | 27 | John Cary | * Devel -> subversion (If this machine will be a Jenkins slave, the version of subversion that is consistent with the Jenkins master's svnkit should be chosen. The latest version supported by svnkit is 1.8.14 at the time, Dec. 31, 2016, of this writing.) |
123 | 3 | Redmine Admin | * Editors -> vim and emacs (and alternate editors of choice) |
124 | * Math -> bc |
||
125 | * Net -> openssh |
||
126 | 25 | Matt Copper | * Net -> curl |
127 | 3 | Redmine Admin | * Python -> python (see note below) |
128 | * Shells -> mintty |
||
129 | * Utils -> diffutils |
||
130 | * Utils -> dos2unix |
||
131 | * Web -> wget |
||
132 | 1 | Redmine Admin | |
133 | * Do NOT install any of the mingw packages. If used, they must be installed separately to overcome path issues. (NumPy will not accept the different, distinguishing name for mingw's gcc). |
||
134 | |||
135 | * Note: PATH should be set such that the Windows python is found before the cygwin python. We need the cygwin python to build PETSc. Once PETSc is cmaked, this requirement will go away. |
||
136 | * Note: mkshortcut.exe in cygutils 1.4.10-2 is broken, but as of (July 18, 2013 with cygutils version 1.4.12 this is fixed). If the version of mkshortcut.exe that is installed when you run setup.exe doesn't work (i.e. mkshortcut -h segfaults), then go bach to cygwin setup and update your cygutils. |
||
137 | |||
138 | ### Setting Cygwin Disk Mounts |
||
139 | |||
140 | * Create the directory winsame at the top level of both the Cygwin and Windows file systems. You must always work in this directory. This is critical for getting the ATLAS linear algebra libraries to build. Do this via: |
||
141 | |||
142 | ~~~~~~ |
||
143 | mkdir /cygdrive/c/winsame |
||
144 | mkdir /winsame |
||
145 | mount C:/winsame /winsame |
||
146 | ~~~~~~ |
||
147 | |||
148 | To make this permanent, put |
||
149 | |||
150 | ~~~~~~ |
||
151 | C:/winsame /winsame ntfs binary 0 0 |
||
152 | ~~~~~~ |
||
153 | |||
154 | as one line in /etc/fstab. |
||
155 | |||
156 | On Windows-64, additionally put |
||
157 | |||
158 | ~~~~~~ |
||
159 | C:/Program\040Files\040(x86) /ProgramFilesX86 ntfs binary 0 0 |
||
160 | ~~~~~~ |
||
161 | |||
162 | as one line in /etc/fstab. This allows one to construct a valid path with no parentheses as needed for ATLAS. |
||
163 | |||
164 | ### Configuring Cygwin |
||
165 | |||
166 | 6 | Redmine Admin | * Use a "Cygwin64 Terminal" from basic cygwin installation above to perform all subsequent bash tasks |
167 | 1 | Redmine Admin | |
168 | * If bilderizing a domain machine, create an /etc/passwd file with the following command |
||
169 | |||
170 | ~~~~~~ |
||
171 | mkpasswd -l -d -p /winsame > /etc/passwd |
||
172 | ~~~~~~ |
||
173 | |||
174 | 71 | Tech-X Corporation | * Add a single domain user to an already created /etc/password: |
175 | |||
176 | ~~~~~~ |
||
177 | mkpasswd -l -d -u {username} -p /winsame >> /etc/passwd |
||
178 | ~~~~~~ |
||
179 | |||
180 | 1 | Redmine Admin | * If bilderizing a non-domain machine, create an /etc/passwd file with the following command |
181 | |||
182 | ~~~~~~ |
||
183 | mkpasswd -l -p /winsame > /etc/passwd |
||
184 | ~~~~~~ |
||
185 | |||
186 | * If bilderizing a domain machine, create an /etc/group file with the following command |
||
187 | |||
188 | ~~~~~~ |
||
189 | mkgroup -l -d > /etc/group |
||
190 | ~~~~~~ |
||
191 | |||
192 | * If bilderizing a non-domain machine, create an /etc/group file with the following command |
||
193 | |||
194 | ~~~~~~ |
||
195 | mkgroup -l > /etc/group |
||
196 | ~~~~~~ |
||
197 | |||
198 | * Close the terminal and open a new one. You should see that the 'pwd' command shows that you are in a new home area directory: /winsame/<username>. Copy bash profile files from /home to /winsame and delete the previous home area for each user with the commands: |
||
199 | |||
200 | ~~~~~~ |
||
201 | cp /home/<username>/.* /winsame/<username>/ |
||
202 | rm -rf /home/<username> |
||
203 | ~~~~~~ |
||
204 | 52 | John Cary | |
205 | 1 | Redmine Admin | ## Dependency Walker |
206 | 52 | John Cary | |
207 | 74 | David Alexander | *Dependency Walker shows the DLL's that an executable depends on and is needed to find and copy-in DLLs to a final distribution.* |
208 | 52 | John Cary | |
209 | 1 | Redmine Admin | __Make sure you download and install the correct version of dependencywalker for your machine (x86 for x86 machines, x64 for 64bit machines, etc).__ |
210 | 5 | Redmine Admin | |
211 | 52 | John Cary | Install [Dependency Walker](http://www.dependencywalker.com/) into C:\\bin. |
212 | 1 | Redmine Admin | |
213 | ## JOM |
||
214 | |||
215 | 74 | David Alexander | *JOM is an nmake wrapper needed to give the -j flag capability of Unix make for faster compilation.* |
216 | 1 | Redmine Admin | |
217 | * Create the folder C:\bin (if not already present). |
||
218 | * Add C:\bin to your system path (if not already there). |
||
219 | * Download jom.zip from [the Qt Project](https://wiki.qt.io/Jom). |
||
220 | * Extract the contents of jom.zip |
||
221 | * Move/copy jom.exe to C:\bin (you then can delete the remainder of the contents or keep for historical reasons). |
||
222 | |||
223 | ## LaTeX |
||
224 | |||
225 | 74 | David Alexander | *LaTeX is a typesetting tool needed for building PDF files for user documentation.* |
226 | 1 | Redmine Admin | |
227 | * Install [Doxygen](http://www.stack.nl/~dimitri/doxygen/download.html). |
||
228 | 77 | John Cary | * Install Basic MikTeX from [MikTeX](http://miktex.org/). Use the MikTeX Package Manager to install breakurl capt-of cmap comment courier ec eepic environ epstopdf eqparbox fancybox fancyvrb framed footnote framed fricychap gensymb helvetic latexmk lineno mdwtools mmap mptopdf multirow newfloat overpic palatino parskip pdftex pifont revtex4 siunitx subfiles symbol tabulary threeparttable titlesec trimspaces txfonts units upquote url wrapfig xcite xcolor xypic zapfding |
229 | 1 | Redmine Admin | * In MikTex Settings application (start from StartMenu), under the General tab, choose "Yes" for "Install missing packages on-the-fly". This ensures that builds won't hang waiting for user to dismiss install package dialogs. |
230 | * Install [ghostscript](http://sourceforge.net/projects/ghostscript/files/GPL%20Ghostscript/9.04/). |
||
231 | |||
232 | |||
233 | ## MPI |
||
234 | |||
235 | 74 | David Alexander | *MPI is a message passing interface for parallel code that is needed for some computation engines.* |
236 | |||
237 | 1 | Redmine Admin | Download the HPC Pack 2008 R2 (Service Pack 4 as of March 2016) from: |
238 | |||
239 | https://www.microsoft.com/en-us/download/details.aspx?id=29992 |
||
240 | |||
241 | The 64bit installer is named HPC2008R2-SP4-Update-x64.zip (the monitor pack & integration pack are separate and optional). |
||
242 | |||
243 | The installers will put mpiexec in your path, but you will need to restart any cygwin shells and the Jenkins slave to make this active. |
||
244 | |||
245 | |||
246 | ## Perl |
||
247 | |||
248 | 74 | David Alexander | *Perl is a programming language needed by some packages such as Qt* |
249 | 1 | Redmine Admin | |
250 | * Download and install [ActiveState Perl](http://www.activestate.com/activeperl/downloads). |
||
251 | |||
252 | ## Python |
||
253 | |||
254 | 74 | David Alexander | *Python is a programming language needed by many packages. Namely, any Python module needs Python to be installed.* |
255 | |||
256 | 14 | Redmine Admin | * As of VS12, bilder builds Python from a checkout of a git repo and no longer needs to be installed by hand. No PATH changes are needed either. |
257 | 1 | Redmine Admin | |
258 | ## Subversion |
||
259 | |||
260 | 84 | John Cary | * Subversion is a revision control tool needed by bilder, for example, to know when packages are out of date.* |
261 | 74 | David Alexander | |
262 | 84 | John Cary | * Install TortoiseSVN with its command line tools. |
263 | 1 | Redmine Admin | |
264 | 84 | John Cary | * With this, you will have two versions of svn on your machine. One is in `/usr/bin` under cygwin, and it is used for direct invocation at the bash command-line. The other is in `\Program Files`, and it is needed for getting repo versions when Bilder is invoked through Jenkins. As of this writing, these two versions must be either 1.8 or 1.9. |
265 | 33 | Tech-X Corporation | |
266 | 1 | Redmine Admin | ~~~~~~ |
267 | $ where svn |
||
268 | 84 | John Cary | C:\cygwin64\bin\svn.exe |
269 | C:\PROGRAM FILES\TORTOISESVN\bin\svn.exe |
||
270 | $ /usr/bin/svn --version | head -1 |
||
271 | svn, version 1.9.7 (r1800392) |
||
272 | $ /cygdrive/c/Program\ Files/TortoiseSVN/bin/svn --version | head -n 1 |
||
273 | svn, version 1.9.7 (r1800392) |
||
274 | 15 | Redmine Admin | ~~~~~~ |
275 | 1 | Redmine Admin | |
276 | ## Visual Studio |
||
277 | 15 | Redmine Admin | |
278 | 74 | David Alexander | *Visual Studio contains the Microsoft command-line compiler (cl) used by packages with C/C++ code.* |
279 | |||
280 | 1 | Redmine Admin | * Bilder works with VS12 (Visual Studio 2013). Since code is moving to C++11 standards, VS12 is required. We recommend you remove older versions of VS such as VS10 and VS9. |
281 | |||
282 | * VS12: Visual Studio 2013 Community Edition from Microsoft [VS12 Download Site](https://www.visualstudio.com/en-US/products/visual-studio-community-vs) |
||
283 | |||
284 | * Install the latest update for Visual Studio. Open Visual Studio application. Going to Help -> About Microsoft Visual Studio, should show you the update version installed. As of July 2015 it is as Update 5. To update go to [Visual Studio Update Download](http://www.microsoft.com/en-us/download/details.aspx?id=48129). |
||
285 | |||
286 | * Ensure that Visual Studio is not in the system path. (Bilder adds this as needed.) |
||
287 | 7 | Redmine Admin | |
288 | 26 | John Cary | ### Compatibility with Python |
289 | 7 | Redmine Admin | |
290 | 1 | Redmine Admin | * Python is built by Bilder. |
291 | |||
292 | 78 | Ted Sume | ### Compatibility with CUDA 9.1 |
293 | * CUDA version 9.1 requires the use of Microsoft Visual Studio 2017 v15.4.5. See [VS2017 Prior Release Download Site](https://www.visualstudio.com/en-us/productinfo/installing-an-earlier-release-of-vs2017) for instructions on downloading a specific Release. |
||
294 | |||
295 | 74 | David Alexander | # Libraries (Required for most builds with Bilder) |
296 | 1 | Redmine Admin | |
297 | ## OpenSSL |
||
298 | |||
299 | 75 | John Cary | *OpenSSL is a security library needed by Python to build the SSL module, by libssh, and by Qt.* |
300 | 1 | Redmine Admin | |
301 | * Download from http://slproweb.com/products/Win32OpenSSL.html |
||
302 | 75 | John Cary | * Choose the Win64 OpenSSL v1.0.2n (not Light) on 64bit or the Win32 OpenSSL v1.0.2n on 32bit windows. |
303 | 76 | John Cary | * **The 1.1 series DOES NOT WORK with either libssh or Qt.** |
304 | 1 | Redmine Admin | * You may have to install Visual C++ Redistributables if the installer complains. |
305 | * During the installation, select "Copy OpenSSL DLLs to: The OpenSSL binaries (/bin) directory" |
||
306 | * After the installation on 64bit windows, goto C:\Windows\System32 and prepend libssl32.dll, libeay32.dll, and ssleay32.dll with an "OFF", if these files exist. This and the next step are required so that dependency walker finds the SSL libs from the OpenSSL distro instead of the ones in C:\Windows\System32. |
||
307 | * Add C:\OpenSSL-Win64 (in some cases, we have seen that C:\OpenSSL-Win64\bin should be added instead) or the directory where you installed OpenSSL to the beginning of the system path. In particular, it needs to be in front of the CollabNet path and the Intel client path, because both contain libeay32.dll. A which for the libeay32.dll should give this installed version. For example: |
||
308 | |||
309 | 30 | John Cary | ~~~~~~ |
310 | which libeay32.dll |
||
311 | 1 | Redmine Admin | /cygdrive/c/OpenSSL-Win64/bin/libeay32.dll |
312 | 73 | Tech-X Corporation | ~~~~~~ |
313 | 30 | John Cary | |
314 | 1 | Redmine Admin | * If built software has unexplained crashes, recheck the above command results. |
315 | |||
316 | 74 | David Alexander | ## Qt |
317 | 1 | Redmine Admin | |
318 | 74 | David Alexander | *Qt is a cross-platform GUI library needed to build packages that have Qt-based user interfaces.* |
319 | |||
320 | Either Qt4 or Qt5 (or both) can be added. Typically only one will be needed. |
||
321 | |||
322 | ### [Building and Installing Qt4](#qt4) |
||
323 | |||
324 | 41 | John Cary | * Make sure no other Qt is in your system path. |
325 | 42 | John Cary | * Get the Qt Libraries from http://download.qt.io/official_releases/qt/4.8/4.8.7/. Download qt-opensource-windows-x86-vs2010-4.8.7.exe. (The vs2010 in the name is irrelevant as we will build Qt using the source code in this download.) |
326 | 41 | John Cary | * Run this program, selecting C:\winsame\builds-vsXX\winqt\<version> as your installation directory, where XX is the version of your Visual Studio. |
327 | * If 4.8.7, patch Qt by opening a Cygwin window: |
||
328 | 1 | Redmine Admin | |
329 | ~~~~~~ |
||
330 | cd /winsame/builds-vs12/winqt/4.8.7 |
||
331 | 26 | John Cary | patch -p1 --binary < /path/to/bilder/patches/qt-4.8.7.patch |
332 | 1 | Redmine Admin | ~~~~~~ |
333 | |||
334 | 74 | David Alexander | #### Compiling Qt4 |
335 | 1 | Redmine Admin | |
336 | * The copy/paste-able commands below assume VS12. |
||
337 | |||
338 | In a Visual Studio x64 DOS window: |
||
339 | |||
340 | ~~~~~~ |
||
341 | set VER=12 |
||
342 | set SFX=vs%VER% |
||
343 | 42 | John Cary | set QTVER=4.8.7 |
344 | 64 | John Cary | set CONTRIB_DIR=C:\winsame\contrib-%SFX% |
345 | ~~~~~~ |
||
346 | |||
347 | Modify the last line as needed, e.g., different drive or subdir. Then |
||
348 | |||
349 | ~~~~~~ |
||
350 | 1 | Redmine Admin | cd C:\winsame\builds-%SFX%\winqt\%QTVER% |
351 | configure.exe -prefix %CONTRIB_DIR%\qt-%QTVER%-sersh -debug-and-release -opensource -confirm-license -fast -no-sql-db2 -no-sql-ibase -no-sql-mysql -no-sql-oci -no-sql-odbc -no-sql-psql -no-sql-sqlite -no-sql-sqlite2 -no-sql-tds -no-libtiff -webkit -declarative |
||
352 | 64 | John Cary | ~~~~~~ |
353 | 1 | Redmine Admin | |
354 | (NOTE: If you are building with Visual Studio 2008, then you'll need to add the following arguments to the above command: -platform win32-msvc2008) |
||
355 | |||
356 | 2 | Redmine Admin | In a bash window launched from the previous DOS window (try `C:\cygwin64\bin\mintty -`, note that the dash is important!), execute the following (changing vsver to your version) |
357 | 1 | Redmine Admin | |
358 | ~~~~~~ |
||
359 | export VER=12 |
||
360 | export SFX=vs${VER} |
||
361 | cd /winsame/builds-${SFX}/winqt/4.8.7 |
||
362 | 26 | John Cary | mkdir -p /winsame/contrib-${SFX}/qt-4.8.7-sersh |
363 | cp -R mkspecs /winsame/contrib-${SFX}/qt-4.8.7-sersh |
||
364 | 1 | Redmine Admin | cd /winsame/contrib-${SFX} |
365 | 26 | John Cary | ln -s qt-4.8.7-sersh qt-sersh |
366 | mkshortcut.exe -n qt-sersh.lnk qt-4.8.7-sersh |
||
367 | 1 | Redmine Admin | ~~~~~~ |
368 | |||
369 | In the Visual Studio x64 DOS window |
||
370 | |||
371 | ~~~~~~ |
||
372 | set VER=12 |
||
373 | set SFX=vs%VER% |
||
374 | 26 | John Cary | cd C:\winsame\builds-%SFX%\winqt\4.8.7 |
375 | set PATH=%PATH%;C:\winsame\builds-%SFX%\winqt\4.8.7\bin |
||
376 | 1 | Redmine Admin | nmake # Took 3.5 hours on a 2.3 GHz Core2 Duo with Solid State Drive |
377 | nmake install # Took 10 minutes on a 2.3 GHZ Core2 Duo with Solid State Drive |
||
378 | ~~~~~~ |
||
379 | |||
380 | * If you want to use this qt outside of Bilder, add C:\winsame\contrib-%SFX%\qt-4.8.7-sersh\bin to the system path variable. This may not work if you have more than one Bilder run. |
||
381 | |||
382 | In the bash window, then execute |
||
383 | |||
384 | ~~~~~~ |
||
385 | /path/to//bilder/setinstald.sh -i /winsame/contrib-$SFX qt,sersh |
||
386 | 43 | John Cary | ~~~~~~ |
387 | 42 | John Cary | |
388 | 81 | David Alexander | |
389 | ### Installing Qt5 |
||
390 | |||
391 | These instructions are how to install the pre-built version of Qt 5 (version 5.10.0 available as of Feb 12, 2018). You will need a Qt account to run the installer. If you don't have one there will be a chance to create a new one. |
||
392 | |||
393 | * Go to https://www.qt.io/download and click on "Go open source" |
||
394 | * Open the downloaded installer "qt-unifed-windows-x86-3.0.2-online.exe" |
||
395 | * Enter your account details or create a new one. |
||
396 | * Select the following components: |
||
397 | ** under Qt->Qt 5.10.0 choose "MSVC 2017 64-bit," "Qt WebEngine" and "Sources" |
||
398 | ** (optionally) under Tools select "Qt Creator 4.5.0 CDB Debugger Support" and "Qt 3D Studio 1.0.0" |
||
399 | |||
400 | |||
401 | 74 | David Alexander | ### [Building and Installing Qt5](#qt5) |
402 | 42 | John Cary | |
403 | 44 | John Cary | * Ruby, http://rubyinstaller.org/, must be installed first. |
404 | 1 | Redmine Admin | * Make sure no other Qt is in your system path. |
405 | 79 | John Cary | * Get the Qt Libraries from http://download.qt.io/official_releases/qt/5.10/5.10.0/qt-opensource-windows-x86-5.10.0.exe |
406 | * Run this program, selecting `C:\winsame\builds-vs2017\winqt\5.10.0` as your installation directory. |
||
407 | * Install Sources and WebEngine, as x64 packages for vs2017. |
||
408 | 42 | John Cary | |
409 | 74 | David Alexander | #### Compiling Qt5 |
410 | 42 | John Cary | |
411 | 68 | John Cary | * The copy/paste-able commands below assume VS2017. |
412 | 42 | John Cary | |
413 | In a Visual Studio x64 DOS window: |
||
414 | 1 | Redmine Admin | |
415 | ~~~~~~ |
||
416 | 68 | John Cary | set VER=2017 |
417 | 42 | John Cary | set SFX=vs%VER% |
418 | 79 | John Cary | set QTVER=5.10.0 |
419 | 68 | John Cary | set CONTRIB_DIR=C:\winsame\contrib-%SFX% |
420 | 70 | John Cary | set CONTRIB_DIR |
421 | 55 | John Cary | ~~~~~~ |
422 | 56 | John Cary | |
423 | 70 | John Cary | Examine the output of the last command to make sure you have the supra-installation directory correct. |
424 | 56 | John Cary | |
425 | 55 | John Cary | ~~~~~~ |
426 | 68 | John Cary | cd C:\winsame\builds-%SFX%\winqt\%QTVER%\%QTVER%\Src |
427 | 69 | John Cary | configure.bat -prefix %CONTRIB_DIR%\qt-%QTVER%-sersh -opensource -confirm-license -release -shared -opengl desktop -no-separate-debug-info -developer-build -make-tool jom -make libs -make tools -no-sql-db2 -no-sql-ibase -no-sql-mysql -no-sql-oci -no-sql-odbc -no-sql-psql -no-sql-sqlite -no-sql-sqlite2 -no-sql-tds -no-libjpeg -no-qml-debug -no-dbus -no-incredibuild-xge -no-directwrite -nomake examples -nomake tests -skip qtandroidextras -skip qtdoc -skip qtlocation -skip qtscript -skip qtserialbus -skip qtserialport -skip qtsensors -skip qtwayland -skip qtspeech |
428 | 1 | Redmine Admin | jom # Took 45 minutes on a 4-core i7 |
429 | jom install # Took 8 minutes on a 4-core i7 |
||
430 | ~~~~~~ |
||
431 | |||
432 | 70 | John Cary | Check that your installation contains Qt5WebEngine. |
433 | 1 | Redmine Admin | |
434 | 79 | John Cary | Check whether the following changes are needed. |
435 | 70 | John Cary | |
436 | 1 | Redmine Admin | ~~~~~~ |
437 | 60 | John Cary | $ diff QtGui QtGui.orig |
438 | 1 | Redmine Admin | 55c55 |
439 | < // #include "qopenglextrafunctions.h" |
||
440 | --- |
||
441 | > #include "qopenglextrafunctions.h" |
||
442 | $ diff qopengl.h qopengl.h.orig |
||
443 | 108c108 |
||
444 | 60 | John Cary | < // # include <QtGui/qopengles2ext.h> |
445 | --- |
||
446 | > # include <QtGui/qopengles2ext.h> |
||
447 | ~~~~~~ |
||
448 | |||
449 | The VisIt team also uses the following. |
||
450 | |||
451 | ~~~~~~ |
||
452 | -mp -ltcg |
||
453 | ~~~~~~ |
||
454 | 58 | David Howdle | |
455 | 62 | John Cary | ### Completing installation |
456 | 1 | Redmine Admin | |
457 | 61 | John Cary | In a bash window: |
458 | |||
459 | ~~~~~~ |
||
460 | 58 | David Howdle | export VER=2017 |
461 | 1 | Redmine Admin | export SFX=vs${VER} |
462 | 79 | John Cary | export QTVER=5.10.0 |
463 | 1 | Redmine Admin | export CONTRIB_DIR=/winsame/contrib-%SFX% |
464 | echo $CONTRIB_DIR |
||
465 | ~~~~~~ |
||
466 | |||
467 | 70 | John Cary | Check that `CONTRIB_DIR` has the same value as before in the cmd shell, up to OS differences. Then |
468 | 1 | Redmine Admin | |
469 | 70 | John Cary | ~~~~~~ |
470 | 79 | John Cary | env QT_BLDRVERSION=5.10.1 /path/to/bilder/setinstald.sh -i $CONTRIB_DIR qt,sersh |
471 | 70 | John Cary | cd $CONTRIB_DIR |
472 | ln -s qt-$QTVER-sersh qt-sersh |
||
473 | mkshortcut -n qt-sersh.lnk qt-$QTVER-sersh |
||
474 | ~~~~~~ |
||
475 | |||
476 | 74 | David Alexander | # Addition Useful Tools |
477 | 70 | John Cary | |
478 | 74 | David Alexander | ## Notepad++ |
479 | |||
480 | * (Optional) Notepad++ is a free source code editor that is a great tool for Windows. |
||
481 | * Download from http://notepad-plus-plus.org/ |
||
482 | * Install and pin to your taskbar. |
||
483 | |||
484 | 1 | Redmine Admin | # Experimental Tools and Libraries |
485 | |||
486 | These tools have not been fully vetted or built, so you need not do these. |
||
487 | |||
488 | ## MinGW |
||
489 | |||
490 | See [[Installing MinGW]]. |
||
491 | |||
492 | ## ATLAS |
||
493 | |||
494 | See [[Installing ATLAS on Windows]]. |
||
495 | |||
496 | # Cygwin and Paths |
||
497 | 8 | Redmine Admin | |
498 | 1 | Redmine Admin | (This section assumes the user is familiar with the relations between Cygwin and Windows paths.) |
499 | 8 | Redmine Admin | |
500 | 1 | Redmine Admin | The path is critical for when there are conflicting executables. This is the case for Subversion and OpenSSL. |
501 | |||
502 | The cygwin and Windows versions of svn are incompatible due to line endings, so care must be taken as to which is used at what time. |
||
503 | |||
504 | The path to cygwin's version of svn will be ahead of the Windows Subversion so as to allow users to checkout a project using /usr/bin/svn and never worry about the Windows version of svn. |
||
505 | |||
506 | The path to the installed OpenSSL needs to be in front of the path to Subversion because during the copying in of OpenSSL libraries depends needs to find the ones in the OpenSSL installation not the Subversion installation. |
||
507 | |||
508 | ## Usage under Jenkins |
||
509 | |||
510 | Jenkins uses `svnkit`, which is compatible with the Windows version of Subversion of the same version number. So for jenkins usage, one must have the same version of `svn` installed across all slaves, and when `Bilder` runs under Jenkins, it must be sure to use the Windows version of `svn`. There are two methods for doing this. First, `bilder/jenkins/jenkinsbild` defines the environment variables, `BILDER_SVN`, `BILDER_SVNDIR`, and `BLDR_SVNVERSION`, which hold the correct executables to be used by `Bilder`. However, in the configuration of some packages, notably VisIT in `visit.sh`, the path is used to find `svn`, and this gives the wrong executable. For these cases, the path is modified just before configuration. |
||
511 | |||
512 | |||
513 | ## Summary |
||
514 | |||
515 | * Bilder moves `/usr/bin` to just after the Python path and therefore to before |
||
516 | `/cygdrive/c/Windows/system32`. |
||
517 | * Put the Windows Subversion path behind the Python path (and so behind `/usr/bin`). |
||
518 | - `/usr/bin` must be removed from the path when configuring some packages in order to get the correct subversion when building under Jenkins. |
||
519 | |||
520 | # Bilder machine files for cygwin |
||
521 | |||
522 | The Bilder machine file for cygwin and Visual Studio 2013 (VS12) is bilder/machines/cygwin.vs12. It is sourced by bilder using the -m option. It augments PATH and sets the values of the INCLUDE, LIB, and LIBPATH variables. |
||
523 | |||
524 | In case of problems, one should check that the values of these were set correctly. This is done by starting up the **Visual Studio Command Prompt**, then starting rxvt as noted above. The values for or additions to these variables should agree with how they are being set or modified by the cygwin machine files. |
||
525 | |||
526 | # Setup for making Installers |
||
527 | |||
528 | ## Visual Studios Redistributables |
||
529 | |||
530 | Download vcredist_x64.exe (Visual C++ Redistributable Packages for Visual Studio 2013) |
||
531 | |||
532 | http://www.microsoft.com/en-gb/download/details.aspx?id=40784 |
||
533 | |||
534 | Choose only vcredist_x64.exe executable from list. Put executable in C:\bin. |
||
535 | |||
536 | ## Sign Tools |
||
537 | |||
538 | * The Microsoft Signtool comes with Visual Studio, however, one must install a code-signing certificate. This process is site-specific so please see your system administrator. |
||
539 | * Contrary to what signtool says, the capicom dll must be copied from C:\Program Files\Microsoft SDKs\Windows\v6.0A\bin to C:\Windows\System32 and must be registered by typing the following at a Command Prompt run as Administrator: |
||
540 | |||
541 | ~~~~~~ |
||
542 | cd C:\Windows\System32 |
||
543 | REGSVR32 capicom.dll |
||
544 | 74 | David Alexander | ~~~~~~ |
545 | |||
546 | ## NSIS |
||
547 | |||
548 | NSIS is a scriptable installer maker. |
||
549 | |||
550 | * Install NSIS from [NSIS Download Site](http://nsis.sourceforge.net/Download). |
||
551 | * For building CMake 64bit and if you are building the composers, you will need a generator for installer executables, which is NSIS (Nullsoft Scriptable Install System) a professional open source system to create Windows installers. |
||
552 | * Version 2.46 is available as of Aug 21, 2011. |
||
553 | |||
554 | * Install NSIS Access Control Plugin from [Access Control Plugin Site](http://nsis.sourceforge.net/AccessControl_plug-in). |
||
555 | |||
556 | Copies directories and files into the NSIS installation as follows: |
||
557 | |||
558 | ~~~~~~ |
||
559 | AccessControl.zip\Contrib\AccessControl --> NSIS\Contrib\AccessControl |
||
560 | AccessControl.zip\Docs\AccessControl --> NSIS\Docs\AccessControl |
||
561 | AccessControl.zip\Plugins\AccessControl.dll --> NSIS\Plugins\x86-ansi\AccessControl.dll |
||
562 | AccessControl.zip\Unicode\Plugins\AccessControl.dll --> NSIS\Plugins\x86-unicode\AccessControl.dll |
||
563 | 1 | Redmine Admin | ~~~~~~ |
564 | |||
565 | # Notes For Development |
||
566 | |||
567 | [[Notes on debugging Windows executables]] |
||
568 | [[Notes on deleting directories and files owned by other users]] |