Sparknlp 282 Introducing MiniLMEmbeddings#14610

Merged

DevinTDHa merged 5 commits intorelease/604-release-candidatefrom

SPARKNLP-282-Implement-MiniLM-Transformer

Jun 24, 2025

Commits on Jun 20, 2025

Add MiniLM and MiniLMEmbeddings classes for efficient sentence embeddings, including support for ONNX and OpenVINO models. Implement tests to validate embedding generation and ensure consistent out…
prabod
committed
Add MiniLM embeddings support by introducing MiniLMEmbeddings class and related test cases. Update imports to include MiniLM in the embeddings module.
prabod
committed
Update MiniLM embeddings documentation and add new MiniLMEmbeddings entry. Correct summary formatting for CamemBert and add MiniLM embeddings details, including usage examples and sources.
prabod
committed
Update MiniLM documentation links in Python and Scala files to point to the correct GitHub repository.
prabod
committed

Commits on Jun 23, 2025

Add new Jupyter notebook for importing and optimizing MiniLM models from HuggingFace using OpenVINO in Spark NLP. Update MiniLM embeddings test to load pretrained model instead of a local path.
prabod
committed