Getting weird error on ubuntu when running tests

[edeandrea]

I'm trying to run the CI on GitHub actions with an ubuntu runner and am seeing the following. It works fine when running on my local machine (macOS).

Code: https://github.com/rh-rad-ai-roadshow/parasol-insurance/tree/private-docs-rag-solution
CI: https://github.com/rh-rad-ai-roadshow/parasol-insurance/blob/private-docs-rag-solution/.github/workflows/simple-build-test.yml

java.lang.RuntimeException: java.lang.RuntimeException: Failed to start quarkus
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:634)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:718)
	at java.base/java.util.Optional.orElseGet(Optional.java:364)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1596)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1596)
Caused by: java.lang.RuntimeException: Failed to start quarkus
	at io.quarkus.runner.ApplicationImpl.doStart(Unknown Source)
	at io.quarkus.runtime.Application.start(Application.java:101)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at io.quarkus.runner.bootstrap.StartupActionImpl.run(StartupActionImpl.java:305)
	at io.quarkus.test.junit.QuarkusTestExtension.doJavaStart(QuarkusTestExtension.java:248)
	at io.quarkus.test.junit.QuarkusTestExtension.ensureStarted(QuarkusTestExtension.java:601)
	at io.quarkus.test.junit.QuarkusTestExtension.beforeAll(QuarkusTestExtension.java:651)
	... 1 more
Caused by: java.lang.UnsatisfiedLinkError: Native Library /home/runner/.djl.ai/tokenizers/0.15.0-0.26.0-linux-x86_64/libtokenizers.so already loaded in another classloader
	at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(NativeLibraries.java:167)
	at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(NativeLibraries.java:139)
	at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2418)
	at java.base/java.lang.Runtime.load0(Runtime.java:852)
	at java.base/java.lang.System.load(System.java:2025)
	at ai.djl.huggingface.tokenizers.jni.LibUtils.loadLibrary(LibUtils.java:76)
	at ai.djl.huggingface.tokenizers.jni.LibUtils.<clinit>(LibUtils.java:41)
	at ai.djl.huggingface.tokenizers.HuggingFaceTokenizer.newInstance(HuggingFaceTokenizer.java:173)
	at dev.langchain4j.model.embedding.onnx.HuggingFaceTokenizer.createFrom(HuggingFaceTokenizer.java:92)
	at dev.langchain4j.model.embedding.onnx.HuggingFaceTokenizer.<init>(HuggingFaceTokenizer.java:38)
	at io.quarkiverse.langchain4j.easyrag.runtime.EasyRagIngestor.ingestDocumentsFromFilesystem(EasyRagIngestor.java:81)
	at io.quarkiverse.langchain4j.easyrag.runtime.EasyRagIngestor.ingest(EasyRagIngestor.java:54)
	at io.quarkiverse.langchain4j.easyrag.runtime.EasyRagRecorder.ingest(EasyRagRecorder.java:42)
	at io.quarkus.deployment.steps.EasyRagProcessor$ingest784711507.deploy_0(Unknown Source)
	at io.quarkus.deployment.steps.EasyRagProcessor$ingest784711507.deploy(Unknown Source)
	... 8 more

[kdubois]

FYI it also works on my local machine with Fedora 40, so not necessarily related to it running in a Linux environment

[edeandrea]

Any thoughts on this one? Definitely weird, but still an issue nonetheless. Its preventing our CI from being able to run.

[geoand]

No ideas here

[edeandrea]

Should I post this to upstream Langchain4j and see what they say?

[geoand]

Maybe @jmartisk has an idea

[edeandrea]

Seems to have resolved itself after updating some dependency versions (NOT Quarkus or langchain versions). Very odd.

I'll close for now and reopen if it appears again.

[geoand]

😎

[edeandrea]

I'm going to reopen this since we are seeing this error again on our CI:

https://github.com/rh-rad-ai-roadshow/parasol-insurance/actions/runs/11071951311/job/30765006606#step:5:4379

Error:  Tests run: 2, Failures: 0, Errors: 1, Skipped: 1, Time elapsed: 20.42 s <<< FAILURE! -- in org.parasol.ui.ClaimsListPageTests
Error:  org.parasol.ui.ClaimsListPageTests.correctTable -- Time elapsed: 0 s <<< ERROR!
java.lang.RuntimeException: java.lang.RuntimeException: Failed to start quarkus
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:634)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:718)
	at java.base/java.util.Optional.orElseGet(Optional.java:364)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1596)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1596)
Caused by: java.lang.RuntimeException: Failed to start quarkus
	at io.quarkus.runner.ApplicationImpl.doStart(Unknown Source)
	at io.quarkus.runtime.Application.start(Application.java:101)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at io.quarkus.runner.bootstrap.StartupActionImpl.run(StartupActionImpl.java:305)
	at io.quarkus.test.junit.QuarkusTestExtension.doJavaStart(QuarkusTestExtension.java:248)
	at io.quarkus.test.junit.QuarkusTestExtension.ensureStarted(QuarkusTestExtension.java:601)
	at io.quarkus.test.junit.QuarkusTestExtension.beforeAll(QuarkusTestExtension.java:651)
	... 1 more
Caused by: java.lang.UnsatisfiedLinkError: Native Library /home/runner/.djl.ai/tokenizers/0.19.1-0.28.0-linux-x86_64/libtokenizers.so already loaded in another classloader
	at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(NativeLibraries.java:167)
	at java.base/jdk.internal.loader.NativeLibraries.loadLibrary(NativeLibraries.java:139)
	at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2418)
	at java.base/java.lang.Runtime.load0(Runtime.java:852)
	at java.base/java.lang.System.load(System.java:2025)
	at ai.djl.huggingface.tokenizers.jni.LibUtils.loadLibrary(LibUtils.java:76)
	at ai.djl.huggingface.tokenizers.jni.LibUtils.<clinit>(LibUtils.java:41)
	at ai.djl.huggingface.tokenizers.HuggingFaceTokenizer.newInstance(HuggingFaceTokenizer.java:184)
	at dev.langchain4j.model.embedding.onnx.HuggingFaceTokenizer.createFrom(HuggingFaceTokenizer.java:92)
	at dev.langchain4j.model.embedding.onnx.HuggingFaceTokenizer.<init>(HuggingFaceTokenizer.java:38)
	at io.quarkiverse.langchain4j.easyrag.runtime.EasyRagIngestor.ingestDocumentsFromFilesystem(EasyRagIngestor.java:81)
	at io.quarkiverse.langchain4j.easyrag.runtime.EasyRagIngestor.ingest(EasyRagIngestor.java:54)
	at io.quarkiverse.langchain4j.easyrag.runtime.EasyRagRecorder.ingest(EasyRagRecorder.java:42)
	at io.quarkus.deployment.steps.EasyRagProcessor$ingest784711507.deploy_0(Unknown Source)
	at io.quarkus.deployment.steps.EasyRagProcessor$ingest784711507.deploy(Unknown Source)
	... 8 more

[jmartisk]

See https://github.com/quarkiverse/quarkus-langchain4j/blob/0.19.0.CR3/embedding-stores/redis/deployment/src/test/java/io/quarkiverse/langchain4j/redis/deployment/RedisEmbeddingStoreTest.java#L58
you probably need to apply a similar workaround in your tests. It's a known bug in the djl library

Also see deepjavalibrary/djl#3020 and langchain4j/langchain4j#776

[edeandrea]

Thanks for that @jmartisk !

To clarify, is it that I would just need to create the EmbeddingModel class directly in the @BeforeAll method, even if I don't use it directly in my tests?

The test class you pointed to - it looks like you are using the embedding model directly within the test class. In my case, I am in a test class annotated with @QuarkusTest, so my test class doesn't use any of the LangChain4j things directly in the class...

[edeandrea]

In my case too I'm not using the AllMiniLmL6V2QuantizedEmbeddingModel. I'm using OllamaEmbeddingModel.