Skip to content

[Codegen] Use DMA for LHS/RHS only in scaled matmul#23760

Draft
lialan wants to merge 2 commits intousers/lialan/subbyte_gather_to_ldsfrom
users/lialan/lower_dma_when_scaled
Draft

[Codegen] Use DMA for LHS/RHS only in scaled matmul#23760
lialan wants to merge 2 commits intousers/lialan/subbyte_gather_to_ldsfrom
users/lialan/lower_dma_when_scaled

Conversation

@lialan
Copy link
Contributor

@lialan lialan commented Mar 12, 2026 •
edited
Loading

  • For now, remove the blanket guard that disabled DMA for all scaled matmuls.
  • When manually enable DMA, XOR swizzle will get disabled (for now). But DMA is by default off so we are good.
  • Use DMA (UseGlobalLoadDMAAttr) for LHS/RHS operands.
  • Fix lowering of DMA copy.

@lialan lialan force-pushed the users/lialan/lower_dma_when_scaled branch from d3c3f1d to f654410 Compare March 12, 2026 20:09
@lialan
[Codegen] Use DMA for LHS/RHS only in scaled matmul
88f6a9a 
* For now, remove the blanket guard that disabled DMA for all scaled matmuls.
* When manually enable DMA, XOR swizzle will get disabled (for now).
* Use DMA (UseGlobalLoadDMAAttr) for LHS/RHS operands.
* Fix lowering of DMA copy.
@lialan lialan force-pushed the users/lialan/lower_dma_when_scaled branch from f654410 to 88f6a9a Compare March 12, 2026 21:25
@lialan lialan force-pushed the users/lialan/lower_dma_when_scaled branch from 6e49c10 to c1f3a75 Compare March 13, 2026 02:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@qedawkins qedawkins Awaiting requested review from qedawkins qedawkins will be requested when the pull request is marked ready for review qedawkins is a code owner

@kuhar kuhar Awaiting requested review from kuhar kuhar will be requested when the pull request is marked ready for review kuhar is a code owner

@Groverkss Groverkss Awaiting requested review from Groverkss Groverkss will be requested when the pull request is marked ready for review Groverkss is a code owner

@nirvedhmeshram nirvedhmeshram Awaiting requested review from nirvedhmeshram nirvedhmeshram will be requested when the pull request is marked ready for review nirvedhmeshram is a code owner

@krzysz00 krzysz00 Awaiting requested review from krzysz00 krzysz00 will be requested when the pull request is marked ready for review krzysz00 is a code owner

@Max191 Max191 Awaiting requested review from Max191 Max191 will be requested when the pull request is marked ready for review Max191 is a code owner

@bjacob bjacob Awaiting requested review from bjacob bjacob will be requested when the pull request is marked ready for review bjacob is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@lialan