Fixes + More Metrics#1

Open

robertgshaw2-redhat wants to merge 1 commit intoronensc:more-metricsfrom

neuralmagic:more-metrics-nm

Commits on Apr 19, 2024

Fixed all the logic related to chunked prefill. Added metrics I had been hacking in my branch. Note: this is not complete. I have not run the code yet, I am sure there are bugs that need to be fixed.
Robert Shaw
committed