Skip to content

model : add ASR support for LFM2-Audio-1.5B (conformer)#18106

Merged
ngxson merged 13 commits intomasterfrom
tarek/feat/lfm2-asr-upstream
Dec 18, 2025
Merged

model : add ASR support for LFM2-Audio-1.5B (conformer)#18106
ngxson merged 13 commits intomasterfrom
tarek/feat/lfm2-asr-upstream

Conversation

@ngxson
Copy link
Contributor

@ngxson ngxson commented Dec 16, 2025

Supersede #17694

  • Rebased to latest master
  • Removed some redundant ggml_cont

@ngxson
Copy link
Contributor Author

ngxson commented Dec 16, 2025

@tdakhran would appreciate if you can do a test on your side! On my side, I confirm that removing some ggml_cont doesn't have negative effects on Metal + CPU

@tdakhran
Copy link
Contributor

@tdakhran would appreciate if you can do a test on your side! On my side, I confirm that removing some ggml_cont doesn't have negative effects on Metal + CPU

@ngxson tested with linux x64 CPU and CUDA, both work 🎉 !

Copy link
Contributor

@tdakhran tdakhran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looked into it one more time, only few nitpicks.
@ngxson fyi I'm not sure this conformer matches upstream conformer, it could be modified.

@github-actions github-actions bot added testing Everything test related Nvidia GPU Issues specific to Nvidia GPUs examples python python script changes ggml changes relating to the ggml tensor library for machine learning labels Dec 16, 2025
@ngxson ngxson merged commit 8ea958d into master Dec 18, 2025
69 of 72 checks passed
Anico2 added a commit to Anico2/llama.cpp that referenced this pull request Jan 15, 2026
* ASR with LFM2-Audio-1.5B

* Set rope_theta

* Fix comment

* Remove rope_theta setting

* Address PR feedback

* rename functions to conformer

* remove some redundant ggml_cont

* fix missing tensor

* add prefix "a." for conv tensors

* remove redundant reshape

* clean up

* add test model

---------

Co-authored-by: Tarek Dakhran <tarek@liquid.ai>
blime4 referenced this pull request in blime4/llama.cpp Feb 5, 2026
* ASR with LFM2-Audio-1.5B

* Set rope_theta

* Fix comment

* Remove rope_theta setting

* Address PR feedback

* rename functions to conformer

* remove some redundant ggml_cont

* fix missing tensor

* add prefix "a." for conv tensors

* remove redundant reshape

* clean up

* add test model

---------

Co-authored-by: Tarek Dakhran <tarek@liquid.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

examples ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs python python script changes testing Everything test related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants