Defer InferenceAPIData gen to worker procs#157

achandrasekar merged 4 commits into

kubernetes-sigs:mainkubernetes-sigs/inference-perf:mainfrom

jjk-g:10kqpsjjk-g/inference-perf:10kqpsCopy head branch name to clipboard