[misc] CUDA Time Layerwise Profiler#8337

Merged

mgoin merged 16 commits intovllm-project:mainfrom

neuralmagic:varun/main-with-profiler

Oct 17, 2024

Commits on Oct 16, 2024

add profiler

Varun Sundar Rabindranath
authored and
LucasWilkinson
committed
refactor
LucasWilkinson
committed
remove cruft
LucasWilkinson
committed
format
LucasWilkinson
committed
fix duplicate entries in the tp > 1 case
LucasWilkinson
committed
add reduce kernel grouping

Varun Sundar Rabindranath
authored and
LucasWilkinson
committed
move to tools folder
LucasWilkinson
committed
Update examples/offline_profile.py

LucasWilkinson
and
mgoin
committed
review comments
LucasWilkinson
committed
add offline profile to "Examples Test"
LucasWilkinson
committed
allow trace saving and add a warmup run
LucasWilkinson
committed
fix deprecation warning
LucasWilkinson
committed
format
LucasWilkinson
committed
review comments
LucasWilkinson
committed
pull in all engine args
LucasWilkinson
committed
rename save traces
LucasWilkinson
committed