Skip to content

Conversation

@ko3n1g
Copy link
Collaborator

@ko3n1g ko3n1g commented May 6, 2025

beep boop [🤖]: Hi @oyilmaz-nvidia 👋,

we've cherry picked #13410 into  for you! 🚀

Please review and approve this cherry pick by your convenience!

* Tests for vLLMHFExporter and TensorRT lazy compiler

Signed-off-by: Onur Yilmaz <[email protected]>

* Adding sentencepiece tokenizer test for export

Signed-off-by: Onur Yilmaz <[email protected]>

* More unit tests for tensorrt_llm.py

Signed-off-by: Onur Yilmaz <[email protected]>

* more tensorrt_mm_exporter tests

Signed-off-by: Onur Yilmaz <[email protected]>

* Fix style

Signed-off-by: Onur Yilmaz <[email protected]>

* Add header

Signed-off-by: Onur Yilmaz <[email protected]>

* Apply isort and black reformatting

Signed-off-by: oyilmaz-nvidia <[email protected]>

* new tests for lora and export utils

Signed-off-by: Onur Yilmaz <[email protected]>

* Apply isort and black reformatting

Signed-off-by: oyilmaz-nvidia <[email protected]>

* Fix some of the codeql issues

Signed-off-by: Onur Yilmaz <[email protected]>

* Add header

Signed-off-by: Onur Yilmaz <[email protected]>

* Marking tests as GPU only

Signed-off-by: Onur Yilmaz <[email protected]>

---------

Signed-off-by: Onur Yilmaz <[email protected]>
Signed-off-by: oyilmaz-nvidia <[email protected]>
Co-authored-by: oyilmaz-nvidia <[email protected]>
Co-authored-by: oliver könig <[email protected]>
@chtruong814
Copy link
Collaborator

CI passed in this PR
#13454

@chtruong814 chtruong814 merged commit ad90230 into r2.3.0 May 9, 2025
261 of 680 checks passed
@chtruong814 chtruong814 deleted the cherry-pick-13410-r2.3.0 branch May 9, 2025 00:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants