Added Faiss

[stemann]

No description provided.

[stemann]

Replaces #8483

[stemann]

@giordano Did something happen to powerpc64le support in OpenBLAS32?
https://buildkite.com/julialang/yggdrasil/builds/16739#0194a24e-577f-4249-9f91-04f5e949e418/687-785

[giordano]

Yes, OpenBLAS 0.3.28 doesn't support PowerPC with libgfortran 3 and 4

[stemann]

Ah yes, I found a385efd

What would be the proper approach here?

1. Require GCC 11 (libgfortran 5)
2. Drop PowerPC64LE
3. Separate build_tarballs call for PowerPC64 with GCC 11

[giordano]

Either require GCC 8 or drop powerpc, up to you.

[giordano]

There's an ICE on aarch64 with gcc 8, move to the next (9)

[giordano]

Sounds like this package is a magnet for GCC ICEs. Good luck

[giordano]

Also, ask yourself how much you care about supporting powerpc vs aarch64

[stemann]

powerpc vs aarch64 ... vs older Linux distributions 😊

Do we have an overview of which releases of the common/main linux distributions one looses when bumping GCC versions...?
E.g. https://access.redhat.com/solutions/19458
I guess it could make sense (just as a convenience) to add a table to https://github.com/JuliaPackaging/Yggdrasil/blob/master/RootFS.md

[giordano]

Do we have an overview of which releases of the common/main linux distributions one looses when bumping GCC versions...?

https://repology.org/project/gcc/versions but I don't see how this is relevant at all.

[stemann]

When working with build recipes, I know that one should use the minimal GCC version, to link against a sufficiently early glibc, but it is (for me) a bit opaque which Linux distributions I loose when I bump, e.g., GCC v7 to v8.

[giordano]

I know that one should use the minimal GCC version, to link against a sufficiently early glibc

Glibc and GCC are completely orthogonal: for a given architecture, we use the same glibc for all versions of GCC, so there's no connection between the two, Glibc version only depends on the architecture, and that's what's reported in RootFS.md.

[giordano]

but it is (for me) a bit opaque which Linux distributions I loose when I bump, e.g., GCC v7 to v8.

There's no connection for anyone who uses julia's default build system, e.g. when using the official binaries.

[stemann]

Ah OK - thanks for clarifying :-)

[stemann]

Hmm... importing/registration of Faiss_jll failed due to MKL...

@giordano Would it be better to just link with libblastrampoline? (and also circumvent OpenBLAS/PowerPC-issues...?)

Similar to MKL issues with Torch: JuliaRegistries/General#68946 (comment)

[ Info: Attempting to `import` package
Precompiling project...
    291.4 ms  ✓ Unicode
    432.2 ms  ✓ Zlib_jll
    500.4 ms  ✓ CompilerSupportLibraries_jll
    600.4 ms  ✓ Preferences
    779.4 ms  ✓ LazyArtifacts
    396.2 ms  ✓ JLLWrappers
    741.9 ms  ✓ LLVMOpenMP_jll
    774.1 ms  ✓ OpenBLAS32_jll
    782.9 ms  ✓ oneTBB_jll
    893.1 ms  ✓ LAPACK_jll
   1221.5 ms  ✓ IntelOpenMP_jll
   3260.8 ms  ✓ MKL_jll
  12226.8 ms  ✓ Faiss_jll
  13 dependencies successfully precompiled in 18 seconds. 21 already precompiled.
  2 dependencies had output during precompilation:
┌ Faiss_jll
│   Downloading artifact: MKL
└  
┌ MKL_jll
│   Downloading artifact: IntelOpenMP
└  
ERROR: InitError: could not load library "/tmp/jl_OhsE09/artifacts/3b754606efe15fe32e87992916170a076ef1db27/lib/libfaiss.so"
libmkl_intel_lp64.so.2: cannot open shared object file: No such file or directory

https://github.com/JuliaRegistries/General/actions/runs/12975113227/job/36185770899?pr=123746#step:17:412

[giordano]

I think I already answered in the link you shared, didn't I?