Skip to content

Commit e250e71

Browse files
authored
Include metrics from upstream chat requests (#361)
* proxy: refactor metrics recording - remove metrics_middleware.go as this wrapper is no longer needed. This also eliminiates double body parsing for the modelID - move metrics parsing to be part of MetricsMonitor - refactor how metrics are recording in ProxyManager - add MetricsMonitor tests - improve mem efficiency of processStreamingResponse - add benchmarks for MetricsMonitor.addMetrics - proxy: refactor MetricsMonitor to be more safe handling errors
1 parent d18dc26 commit e250e71

File tree

6 files changed

+939
-289
lines changed

6 files changed

+939
-289
lines changed

proxy/metrics_middleware.go

Lines changed: 0 additions & 184 deletions
This file was deleted.

0 commit comments

Comments
 (0)