Adding support for Context Parallelism using Deepseed's DistributedAt…#1501

Merged

regisss merged 4 commits intohuggingface:mainfrom

bhargaveede:context_parallelism

Dec 3, 2024

Commits on Nov 21, 2024

Adding support for Context Parallelism using Deepseed's DistributedAttention
Bhargav
committed

Commits on Dec 2, 2024

Addressing review comments
Bhargav
committed
Merge branch 'main' into context_parallelism
Bhargav
authored

Commits on Dec 3, 2024

Merge remote-tracking branch 'optimum-habana/main' into context_parallelism
regisss
committed