How to not compile binaries / examples of HiGHS with CMake?

[amontoison]

I prepared a script to cross-compile all dependencies of Uno as static libraries and I would like to avoid any call to the linker.
Do you have an option to do that with CMake?
I use the following script:

mkdir build
cd build
if [[ "${target}" == *-mingw* ]]; then
    LIBGFORTRAN=libgfortran-5
else
    LIBGFORTRAN=libgfortran
fi
cmake .. \
    -DCMAKE_INSTALL_PREFIX=${prefix} \
    -DCMAKE_TOOLCHAIN_FILE=${CMAKE_TARGET_TOOLCHAIN} \
    -DCMAKE_BUILD_TYPE=Release \
    -DBUILD_SHARED_LIBS=OFF \
    -DHIPO=ON \
    -DBUILD_TESTING=OFF \
    -DUILD_CXX_EXE=OFF \
    -DBLAS_LIBRARIES="${prefix}/lib/libcblas.a;${prefix}/lib/libblas.a;${libdir}/${LIBGFORTRAN}.${dlext}"

make -j ${nproc}
make install

The last line -DBLAS_LIBRARIES="${prefix}/lib/libcblas.a;${prefix}/lib/libblas.a;${libdir}/${LIBGFORTRAN}.${dlext}" was required for the linker even if don't want the binary highs for libuno.

@odow It can be also relevant for HiGHS_jll,jl.
We probably don't need to compile the examples.
For example, the option -DBUILD_TESTING=OFF could be already used.
It will reduce the size of the tarballs.

[jajhall]

Can this be accommodated @galabovaa ?

[galabovaa]

In your script there is a typo @amontoison, to switch the executable off it should be

    -DBUILD_CXX_EXE=OFF \

[amontoison]

Thanks @galabovaa !
The bug was between the chair and the screen :)

But now I have another issue:

[12:25:04]  ---> cmake .. -DCMAKE_INSTALL_PREFIX=${prefix} -DCMAKE_TOOLCHAIN_FILE=${CMAKE_TARGET_TOOLCHAIN} -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=OFF -DHIPO=ON -DBUILD_TESTING=OFF -DBUILD_CXX_EXE=OFF -DMETIS_ROOT=${prefix}
[12:25:04] Re-run cmake no build system arguments
[12:25:04] -- The CXX compiler identification is GNU 10.2.0
[12:25:04] -- The C compiler identification is GNU 10.2.0
[12:25:04] -- Detecting CXX compiler ABI info
[12:25:04] -- Detecting CXX compiler ABI info - done
[12:25:04] -- Check for working CXX compiler: /opt/bin/aarch64-linux-gnu-libgfortran5-cxx11/aarch64-linux-gnu-g++ - skipped
[12:25:04] -- Detecting CXX compile features
[12:25:04] -- Detecting CXX compile features - done
[12:25:04] -- Detecting C compiler ABI info
[12:25:04] -- Detecting C compiler ABI info - done
[12:25:04] -- Check for working C compiler: /opt/bin/aarch64-linux-gnu-libgfortran5-cxx11/aarch64-linux-gnu-gcc - skipped
[12:25:04] -- Detecting C compile features
[12:25:04] -- Detecting C compile features - done
[12:25:04] -- HIGHS version: 1.12.0
[12:25:04] -- Git hash: 755a8e027a
[12:25:04] -- Build C++ library: ON
[12:25:04] -- Build C++ executable: OFF
[12:25:04] -- Build Fortran: OFF
[12:25:04] -- Build CSharp: OFF
[12:25:04] -- Build Python: OFF
[12:25:04] -- Build all tests: OFF
[12:25:04] -- ZLIB: ON
[12:25:04] -- Build pdlp with GPU: OFF
[12:25:04] -- Use FindCUDAConf: OFF
[12:25:04] -- Build HIPO: ON
[12:25:05] -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
[12:25:05] -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
[12:25:05] -- Looking for pthread_create in pthreads
[12:25:05] -- Looking for pthread_create in pthreads - not found
[12:25:05] -- Looking for pthread_create in pthread
[12:25:05] -- Looking for pthread_create in pthread - found
[12:25:05] -- Found Threads: TRUE
[12:25:05] -- Looking for sgemm_
[12:25:05] -- Looking for sgemm_ - not found
[12:25:05] -- Looking for sgemm_
[12:25:05] -- Looking for sgemm_ - not found
[12:25:05] CMake Error at /workspace/x86_64-linux-musl-cxx11/artifacts/ad7208a4ced08583d8de5ea54d45657c49b595de/share/cmake-3.31/Modules/FindPackageHandleStandardArgs.cmake:233 (message):
[12:25:05]   Could NOT find BLAS (missing: BLAS_LIBRARIES)
[12:25:05] Call Stack (most recent call first):
[12:25:05]   /workspace/x86_64-linux-musl-cxx11/artifacts/ad7208a4ced08583d8de5ea54d45657c49b595de/share/cmake-3.31/Modules/FindPackageHandleStandardArgs.cmake:603 (_FPHSA_FAILURE_MESSAGE)
[12:25:05]   /workspace/x86_64-linux-musl-cxx11/artifacts/ad7208a4ced08583d8de5ea54d45657c49b595de/share/cmake-3.31/Modules/FindBLAS.cmake:1419 (find_package_handle_standard_args)
[12:25:05]   cmake/FindHipoDeps.cmake:127 (find_package)
[12:25:05]   CMakeLists.txt:195 (include)
[12:25:05] 
[12:25:05] 
[12:25:05] -- Configuring incomplete, errors occurred!
[12:25:05]  ---> cmake .. -DCMAKE_INSTALL_PREFIX=${prefix} -DCMAKE_TOOLCHAIN_FILE=${CMAKE_TARGET_TOOLCHAIN} -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=OFF -DHIPO=ON -DBUILD_TESTING=OFF -DBUILD_CXX_EXE=OFF -DMETIS_ROOT=${prefix}
[12:25:05]  ---> cmake .. -DCMAKE_INSTALL_PREFIX=${prefix} -DCMAKE_TOOLCHAIN_FILE=${CMAKE_TARGET_TOOLCHAIN} -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=OFF -DHIPO=ON -DBUILD_TESTING=OFF -DBUILD_CXX_EXE=OFF -DMETIS_ROOT=${prefix}
[12:25:05] Previous command exited with 1
[12:25:05] Child Process exited, exit code 1
ERROR: LoadError: Build for UnoUtils on aarch64-linux-gnu-libgfortran5 did not complete successfully

It failed for aarch64-linux-gnu-libgfortran5 but it worked for aarch64-apple-darwin-libgfortran5.
We don't need the dependencies when we only generate static libraries.

[amontoison]

You request the dependency because you still compile some examples, even if -DBUILD_TESTING=OFF:

[12:36:50] ld: symbol(s) not found for architecture arm64
[12:36:50] clang++: error: linker command failed with exit code 1 (use -v to see invocation)
[12:36:50] make[2]: *** [examples/CMakeFiles/call_highs_from_c_minimal.dir/build.make:104: bin/call_highs_from_c_minimal] Error 1

[12:36:51] ld: symbol(s) not found for architecture arm64
[12:36:51] clang++: error: linker command failed with exit code 1 (use -v to see invocation)
[12:36:51] make[2]: *** [examples/CMakeFiles/call_highs_from_cpp.dir/build.make:104: bin/call_highs_from_cpp] Error 1
[12:36:51] make[2]: Leaving directory '/workspace/srcdir/HiGHS/build'
[12:36:51] make[1]: *** [CMakeFiles/Makefile2:187: examples/CMakeFiles/call_highs_from_cpp.dir/all] Error 2

[galabovaa]

Btw you can use

-DBUILD_EXAMPLES=OFF

to switch the examples off.

You should remove -DMETIS_ROOT because metis is now included in the source code of HiGHS, along with amd and rcm.

[galabovaa]

I thought we still need the blas headers at compile time even for a static lib

[amontoison]

It depends if you use cblas or not but the header != library.
The header for the few cblas routines used by HiGHS can be in the HiGHS repository, we can't easily do that for the library.

I have a double free error with HiGHS v1.13. I still cross-compile HiGHS v1.12.
We need to understand what is the issue with Charlie.

[amontoison]

[12:50:16]  ---> cmake .. -DCMAKE_INSTALL_PREFIX=${prefix} -DCMAKE_TOOLCHAIN_FILE=${CMAKE_TARGET_TOOLCHAIN} -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=OFF -DHIPO=ON -DBUILD_EXAMPLES=OFF -DBUILD_TESTING=OFF -DBUILD_CXX_EXE=OFF -DMETIS_ROOT=${prefix}
[12:50:16] Re-run cmake no build system arguments
[12:50:16] -- The CXX compiler identification is GNU 10.2.0
[12:50:17] -- The C compiler identification is GNU 10.2.0
[12:50:17] -- Detecting CXX compiler ABI info
[12:50:17] -- Detecting CXX compiler ABI info - done
[12:50:17] -- Check for working CXX compiler: /opt/bin/aarch64-linux-gnu-libgfortran5-cxx11/aarch64-linux-gnu-g++ - skipped
[12:50:17] -- Detecting CXX compile features
[12:50:17] -- Detecting CXX compile features - done
[12:50:17] -- Detecting C compiler ABI info
[12:50:17] -- Detecting C compiler ABI info - done
[12:50:17] -- Check for working C compiler: /opt/bin/aarch64-linux-gnu-libgfortran5-cxx11/aarch64-linux-gnu-gcc - skipped
[12:50:17] -- Detecting C compile features
[12:50:17] -- Detecting C compile features - done
[12:50:17] -- HIGHS version: 1.12.0
[12:50:17] -- Git hash: 755a8e027a
[12:50:17] -- Build C++ library: ON
[12:50:17] -- Build C++ executable: OFF
[12:50:17] -- Build Fortran: OFF
[12:50:17] -- Build CSharp: OFF
[12:50:17] -- Build Python: OFF
[12:50:17] -- Build all tests: OFF
[12:50:17] -- ZLIB: ON
[12:50:17] -- Build pdlp with GPU: OFF
[12:50:17] -- Use FindCUDAConf: OFF
[12:50:17] -- Build HIPO: ON
[12:50:17] -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
[12:50:17] -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
[12:50:17] -- Looking for pthread_create in pthreads
[12:50:17] -- Looking for pthread_create in pthreads - not found
[12:50:17] -- Looking for pthread_create in pthread
[12:50:17] -- Looking for pthread_create in pthread - found
[12:50:17] -- Found Threads: TRUE
[12:50:17] -- Looking for sgemm_
[12:50:17] -- Looking for sgemm_ - not found
[12:50:17] -- Looking for sgemm_
[12:50:17] -- Looking for sgemm_ - not found
[12:50:17] CMake Error at /workspace/x86_64-linux-musl-cxx11/artifacts/ad7208a4ced08583d8de5ea54d45657c49b595de/share/cmake-3.31/Modules/FindPackageHandleStandardArgs.cmake:233 (message):
[12:50:17]   Could NOT find BLAS (missing: BLAS_LIBRARIES)
[12:50:17] Call Stack (most recent call first):
[12:50:17]   /workspace/x86_64-linux-musl-cxx11/artifacts/ad7208a4ced08583d8de5ea54d45657c49b595de/share/cmake-3.31/Modules/FindPackageHandleStandardArgs.cmake:603 (_FPHSA_FAILURE_MESSAGE)
[12:50:17]   /workspace/x86_64-linux-musl-cxx11/artifacts/ad7208a4ced08583d8de5ea54d45657c49b595de/share/cmake-3.31/Modules/FindBLAS.cmake:1419 (find_package_handle_standard_args)
[12:50:17]   cmake/FindHipoDeps.cmake:127 (find_package)
[12:50:17]   CMakeLists.txt:195 (include)

It is HIPO that is always checking for BLAS even if we compile a static library.

[galabovaa]

Is this the sort of header that we need to allow for static linking, @amontoison ? cc @filikat

https://github.com/ERGO-Code/HiGHS/blob/master/highs/ipm/hipo/auxiliary/mycblas.h

The reason it passed on mac but not linux is that on macos Apple Accelerate is used

#2836

Here I removed the REQUIRED check to allow for a static build without specifying openblas. Tested locally on linux and it worked fine

[amontoison]

@galabovaa Yes, it is the header that you need for the compilation (shared or static).

The library with the related symbols (like libcblas.a) is just not needed in the static case because we don't call the linker (to generate libhighs.a).

Note that if any binary is generated (tests, examples, executable highs, etc...) you will call the linker and all symbols need to be resolved at this moment. You need the dependencies in this case.

[jajhall]

Closed by #2836