Skip to content

Conversation

@kaushikmitr
Copy link
Contributor

This pull request enhances the latencypredictor/build-deploy.sh script and refactors quantile metric calculations in training_server.py to improve test automation and model evaluation. The build/deploy script now supports building, pushing, and deploying a dedicated test image and job, providing comprehensive testing capabilities. The training server code is refactored to ensure consistent feature engineering and column selection for quantile metric calculations, reducing errors and improving maintainability.

Build and deployment automation:

  • Added support in build-deploy.sh for building, tagging, and pushing a dedicated test Docker image (latencypredictor-test) when Dockerfile-test is present, including logic to skip test image steps if the file is missing. [1] [2] [3] [4]
  • Implemented functions to deploy a test job to GKE, generate a default test-job.yaml manifest if missing, run tests via the test image, and clean up test jobs after execution.
  • Expanded the CLI interface to include new commands for test deployment, comprehensive testing, image listing, and a full build-push-deploy-test pipeline. [1] [2] [3] [4]

Model evaluation and feature engineering:

  • Refactored _calculate_quantile_metrics_on_test in training_server.py to consistently apply feature engineering and select feature columns based on model type and name, improving reliability and reducing manual errors.
  • Updated calls to _calculate_quantile_metrics_on_test in the training workflow to pass raw test data and model names, ensuring feature columns are determined internally and consistently. [1] [2]

@netlify
Copy link

netlify bot commented Nov 13, 2025

Deploy Preview for gateway-api-inference-extension ready!

Name Link
🔨 Latest commit 42530da
🔍 Latest deploy log https://app.netlify.com/projects/gateway-api-inference-extension/deploys/69154d2852bcc600089298ef
😎 Deploy Preview https://deploy-preview-1854--gateway-api-inference-extension.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Nov 13, 2025
@ahg-g
Copy link
Contributor

ahg-g commented Nov 14, 2025

/lgtm
/approve
/hold

please remove the hold if @BenjaminBraunDev reviewed this

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Nov 14, 2025
@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Nov 14, 2025
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ahg-g, kaushikmitr

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Nov 14, 2025
@BenjaminBraunDev
Copy link
Contributor

Reviewed, this LGTM

@ahg-g
Copy link
Contributor

ahg-g commented Nov 15, 2025

/hold cancel

@k8s-ci-robot k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Nov 15, 2025
@k8s-ci-robot k8s-ci-robot merged commit 5ce1385 into kubernetes-sigs:main Nov 15, 2025
11 checks passed
rlakhtakia pushed a commit to rlakhtakia/gateway-api-inference-extension that referenced this pull request Nov 17, 2025
…bernetes-sigs#1854)

* fix training server indentation bug and test yaml to build script

* add boilerplate header to build deploy script
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants