Merge main#1

Merged

orangetin merged 7 commits intoorangetin/long-newfrom

Sep 29, 2023

Commits on Jun 30, 2023

add kv_head_mapping for grouped attention
OlivierDehaene
committed

Commits on Jul 28, 2023

merge from https://github.com/vllm-project/vllm/pull/420
OlivierDehaene
committed

Commits on Sep 4, 2023

Backport https://github.com/huggingface/candle/issues/443#issuecomment-1704945436
Narsil
committed

Commits on Sep 6, 2023

Commits on Sep 7, 2023

Update attention_kernels.cu
zhangce
authored

Commits on Sep 29, 2023

Merge branch 'orangetin/long-new' into merge-main
orangetin
authored