[AMD][ROCm]Quantization methods on ROCm; Fix _scaled_mm call#8380

Merged

simon-mo merged 8 commits intovllm-project:mainfrom

ROCm:rocm_quantization_enablement

Sep 18, 2024

Commits on Sep 11, 2024

Enabling compressed-tensors and fbgemm quantization on rocm. Fixing scaled_mm required parameters
gshtras
committed

Commits on Sep 12, 2024

Update run-amd-test.sh - enable tests/kernels/test_fp8_quant.py
Alexei-V-Ivanov-AMD
authored

Commits on Sep 16, 2024

Merge remote-tracking branch 'origin/main' into rocm_quantization_enablement
gshtras
committed

Commits on Sep 17, 2024

Merge remote-tracking branch 'origin/main' into rocm_quantization_enablement
gshtras
committed