Add INT4 + LoRA support with tensor materialization#28793

Closed

sheikheddy wants to merge 11 commits intovllm-project:mainfrom

sheikheddy:main

Commits on Nov 16, 2025

feat: Add INT4 compressed-tensors + LoRA support

sheikheddy
and
claude
committed
fix: Add LoRA compatibility to compressed-tensors MoE methods

sheikheddy
and
claude
committed
fix: Correct embedding dimension logic in LoRA dummy creation

sheikheddy
and
claude
committed
fix: Add LoRA compatibility to W4A4 and W4A8 MoE methods
sheikheddy
committed
Add INT4 + LoRA support with tensor materialization for vLLM

sheikheddy
and
claude
committed
Add LoRA compatibility detection and validation results

sheikheddy
and
claude
committed
Apply ruff linting and formatting
sheikheddy
committed

Commits on Nov 17, 2025

Commits on Nov 18, 2025

Add Lambda Labs setup scripts and comprehensive documentation

sheikheddy
and
claude
committed