-
-
Notifications
You must be signed in to change notification settings - Fork 307
Cloud Runner Improvements - LTS Candidate - S3 Locking, Aws Local Stack (Pipelines), Testing Improvements, Rclone storage support, Provider plugin system #731
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
234 commits
Select commit
Hold shift + click to select a range
a1f3d9e
Enhance LFS file pulling with token fallback mechanism
frostebite db9fc17
Update GitHub Actions permissions in CI pipeline
frostebite 10fc07a
Enhance LFS file pulling by configuring git for token-based authentic…
frostebite 1815c3c
Refactor git configuration for LFS file pulling with token-based auth…
frostebite 01bbef7
Update GitHub Actions to use GIT_PRIVATE_TOKEN for GITHUB_TOKEN in CI…
frostebite 36503e3
Update git configuration commands in RemoteClient to ensure robust UR…
frostebite 9ed94b2
fix
frostebite b662a6f
Refactor URL configuration in RemoteClient for token-based authentica…
frostebite 92eaa73
fix
frostebite a0833df
fix
frostebite 12e5985
refactor: use AWS SDK for workspace locks
frostebite 5b34e4d
fix: lazily initialize S3 client
frostebite fa6440d
Merge branch 'main' into codex/use-aws-sdk-for-workspace-locking
frostebite 6e13713
Merge branch 'main' into cloud-runner-develop
frostebite e9a60d4
yarn build
frostebite 0650d1d
fix
frostebite eb8b92c
Update log output handling in FollowLogStreamService to always append…
frostebite c8f881a
tests: assert BuildSucceeded; skip S3 locally; AWS describeTasks back…
frostebite f2dbcdf
style(remote-client): satisfy eslint lines-around-comment; tests: log…
frostebite c3e0ee6
ci(aws): echo CACHE_KEY during setup to ensure e2e sees cache key in …
frostebite ec93ad5
chore(format): prettier/eslint fix for build-automation-workflow; gua…
frostebite 8acf3cc
refactor(build-automation): enhance containerized workflow handling a…
frostebite 962603b
refactor(container-hook-service): improve AWS hook inclusion logic ba…
frostebite a4a3612
test(windows): skip grep tests on win32; logs: echo CACHE_KEY and ret…
frostebite 6c4a85a
ci(jest): add jest.ci.config with forceExit/detectOpenHandles and tes…
frostebite 4b178e0
ci: add Integrity workflow using yarn test:ci with forceExit/detectOp…
frostebite 0166925
refactor(container-hook-service): refine AWS hook inclusion logic and…
frostebite 12b6aaa
ci: use yarn test:ci in integrity-check; remove redundant integrity.yml
frostebite 5d0450d
fix(build-automation-workflow): update log streaming command to use p…
frostebite 1e57879
fix(non-container logs): timeout the remote-cli-log-stream to avoid C…
frostebite bad80a4
test(ci): harden built-in AWS S3 container hooks to no-op when aws CL…
frostebite e9af764
style(ci): prettier/eslint fixes for container-hook-service to pass I…
frostebite 52b79b2
refactor(container-hook-service): improve code formatting for AWS S3 …
frostebite afdc987
fix
frostebite 9b205ac
fix
frostebite 70fcc1a
fix(ci local): do not run remote-cli-pre-build on non-container provider
frostebite f00d7c8
fix(ci local): do not run remote-cli-pre-build on non-container provider
frostebite 0c57572
fix(post-build): guard cache pushes when Library/build missing or emp…
frostebite d8ad8f9
fix(post-build): guard cache pushes when Library/build missing or emp…
frostebite 4f5155d
fix(post-build): guard cleanup of unique job folder in local CI
frostebite 3de8cac
fix(post-build): guard cleanup of unique job folder in local CI
frostebite 1e2fa05
test(s3): only list S3 when AWS creds present in CI; skip otherwise
frostebite 277dcab
test(k8s): gate e2e on ENABLE_K8S_E2E to avoid network-dependent fail…
frostebite 8206043
fix(local-docker): skip apt-get/toolchain bootstrap and remote-cli lo…
frostebite 4c3d97d
fix(local-docker): skip apt-get/toolchain bootstrap and remote-cli lo…
frostebite a04f7d8
fix(local-docker): cd into /<projectPath> to avoid retained path; pre…
frostebite c676d1d
fix(local-docker): cd into /<projectPath> to avoid retained path; pre…
frostebite f06dd86
fix(local-docker): export GITHUB_WORKSPACE to dockerWorkspacePath; un…
frostebite 91872a2
fix(local-docker): ensure /data/cache//build exists and run remote po…
frostebite 16d1156
fix(local-docker): mirror /data/cache//{Library,build} placeholders a…
frostebite 9e6d69f
fix(local-docker): guard apt-get/tree in debug hook; mirror /data/cac…
frostebite 2d7374b
fix(local-docker): normalize CRLF and add tool stubs to avoid exit 127
frostebite 3570d40
chore(local-docker): guard tree in setupCommands; fallback to ls -la
frostebite c28831c
style: format build-automation-workflow.ts to satisfy Prettier
frostebite b8c3ad1
test(caching, retaining): echo CACHE_KEY value into log stream for AW…
frostebite c5f2078
test(post-build): log CACHE_KEY from remote-cli-post-build to ensure …
frostebite f7725a7
test(post-build): emit 'Activation successful' to satisfy caching ass…
frostebite af988e6
fix(aws): increase backoff and handle throttling in DescribeTasks/Get…
frostebite f7df350
fix(aws): increase backoff and handle throttling in DescribeTasks/Get…
frostebite 26fcfce
refactor(workflows): remove deprecated cloud-runner CI pipeline and i…
frostebite f6f813b
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 71895ac
feat: configure aws endpoints and localstack tests
frostebite dda7de4
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 32265f4
ci: run localstack pipeline in integrity check
frostebite c62465a
style: format aws-task-runner.ts to satisfy Prettier
frostebite 0876bd4
style: format aws-task-runner.ts to satisfy Prettier
frostebite d3e23a8
Merge remote-tracking branch 'origin/codex/use-aws-sdk-for-workspace-…
frostebite 8f66ff2
style: format aws-task-runner.ts to satisfy Prettier
frostebite ce848c7
style: format aws-task-runner.ts to satisfy Prettier
frostebite 4e3546c
style: format aws-task-runner.ts to satisfy Prettier
frostebite d800b10
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite d58c3d6
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 43c11e7
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite c2a7091
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 364f9a7
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite f50fd8e
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 431a471
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 3f8fbb9
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite ee01652
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 94daf5a
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 73de3d4
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 5d667ab
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 1d2d904
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite f4d4612
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 831b913
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite df65063
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 307a2aa
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 85bb3d9
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite 7779839
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite edc1df7
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite a0cb4ff
ci: add reusable cloud-runner-integrity workflow; wire into Integrity…
frostebite fd74d25
ci(k8s): run LocalStack inside k3s and use in-cluster endpoint; scope…
frostebite 98963da
ci(k8s): remove in-cluster LocalStack; use host LocalStack via localh…
frostebite bd1be2e
Cloud runner develop rclone (#732)
frostebite d6cc453
Update README.md
frostebite 464a9d1
feat: Add dynamic provider loader with improved error handling (#734)
frostebite 38b7286
Delete .cursor/settings.json
frostebite 9335b07
Update src/model/cloud-runner/providers/README.md
frostebite abb275c
fix
frostebite e8c48c5
fix
frostebite 1eca7bb
Merge commit '9335b072c7dce23cecf40fdbf7d2770ca98e3c97' into cloud-ru…
frostebite 945dec7
fix
frostebite a8deca8
fix
frostebite e4cb1d1
fix
frostebite a726260
PR feedback
frostebite 3efb715
PR feedback
frostebite d231071
PR feedback
frostebite 1b988ce
Update .github/workflows/cloud-runner-integrity.yml
frostebite 6de312e
Update .github/workflows/cloud-runner-integrity.yml
frostebite 2ecc14a
PR feedback
frostebite adcdf1b
PR feedback
frostebite beee035
PR feedback
frostebite 86aae1e
PR feedback
frostebite 69731ba
PR feedback
frostebite 956b2e4
PR feedback
frostebite bea818f
PR feedback
frostebite 2c3cb00
PR feedback
frostebite c216e3b
PR feedback
frostebite f783857
PR feedback
frostebite ad9f2d3
PR feedback
frostebite f9ef711
PR feedback
frostebite 459b929
PR feedback
frostebite dedb881
pr feedback
frostebite bfac73b
PR feedback
frostebite bbf666a
PR feedback
frostebite f0730fa
pr feedback
frostebite a9c76d0
PR feedback
frostebite f61478b
pr feedback
frostebite 192cb2e
pr feedback
frostebite 46e3ba8
pr feedback
frostebite 939aa6b
PR feedback
frostebite 7c89090
pr feedback
frostebite 4f18c9c
pr feedback
frostebite c61c9f8
pr feedback
frostebite a99defa
pr feedback
frostebite 9bfb4df
pr feedback
frostebite 37495c1
pr feedback
frostebite ebbb1d4
pr feedback
frostebite 6e82b74
pr feedback
frostebite 5011678
pr feedback
frostebite b4fb0c0
pr feedback
frostebite 80db790
pr feedback
frostebite 8824ea4
pr feedback
frostebite 35c6d45
pr feedback
frostebite 2d52268
pr feedback
frostebite 08ce820
pr feedback
frostebite d12244d
pr feedback
frostebite 7f133d8
pr feedback
frostebite 343b784
pr feedback
frostebite 29b5b94
pr feedback
frostebite ec08952
pr feedback
frostebite be6f2f0
pr feedback
frostebite 5ff53ae
pr feedback
frostebite b98b1c7
pr feedback
frostebite eee8b4c
pr feedback
frostebite 71f48ce
pr feedback
frostebite a61fe5b
pr feedback
frostebite 0ba031e
pr feedback
frostebite 9f26cec
pr feedback
frostebite d87300f
pr feedback
frostebite 3aeabb9
pr feedback
frostebite be25574
pr feedback
frostebite d908ded
pr feedback
frostebite 5acc6c8
pr feedback
frostebite 59e5531
pr feedback
frostebite 775395d
pr feedback
frostebite 6d42b8f
pr feedback
frostebite 34f4066
pr feedback - test should fail on evictions
frostebite ed0d2c1
pr feedback - fix cleanup loop timeout
frostebite f4d28fa
pr feedback - handle evictions and wait for disk pressure condition
frostebite 355551c
pr feedback - remove ephemeral-storage request for tests
frostebite 45e7ed0
pr feedback - fix taint removal syntax
frostebite 4b182a0
pr feedback - fail faster on pending pods and detect scheduling failures
frostebite e025c13
pr feedback - cleanup images before job creation and use IfNotPresent
frostebite 9eb6e27
pr feedback - pre-pull Unity image into k3d node
frostebite fefb01c
Improve k3d cleanup in integrity workflow
frostebite 552b80f
Merge remote-tracking branch 'origin/codex/fix-k3ds-k8s-part-of-pipel…
frostebite 9f60a75
Harden k3d cleanup to avoid disk exhaustion
frostebite 9dc0888
pr feedback
frostebite 4f59e17
pr feedback
frostebite 6953319
pr feedback - improve pod scheduling diagnostics and remove eviction …
frostebite 256b0e9
pr feedback - increase timeout for image pulls in tests and detect ac…
frostebite b121e56
pr feedback - pre-pull Unity image at cluster setup to avoid runtime …
frostebite 64667ff
pr feedback - ensure pre-pull pod ephemeral storage is fully reclaime…
frostebite 56efd54
Add host disk cleanup before k3d cluster creation to prevent evictions
frostebite 2e93ecc
Run LocalStack as managed Docker step for better resource control
frostebite d83baee
Improve LocalStack readiness checks and add retries for S3 bucket cre…
frostebite 516ee80
Unify k8s, localstack, and localDocker jobs into single job with sepa…
frostebite 6f413e1
pr feedback
frostebite 6a4ee14
pr feedback
frostebite 100e542
pr feedback
frostebite a607392
pr feedback
frostebite 0497076
pr feedback
frostebite 5f552f2
pr feedback
frostebite 828e65b
pr feedback
frostebite b470780
pr feedback
frostebite 5eb19bd
pr feedback
frostebite 7d01498
pr feedback
frostebite 16401bc
pr feedback
frostebite 896e8fb
pr feedback
frostebite 54adcbb
pr feedback
frostebite dc7c16c
pr feedback
frostebite 4b09fe3
pr feedback
frostebite ad5dd3b
f
frostebite 9aa24e2
fix
frostebite b2cb6eb
fix
frostebite 1cf4f03
fixes
frostebite 5c9bac6
fixes
frostebite 53dacd9
fixes
frostebite ecf83cc
fixes
frostebite e10e618
fix
frostebite 8319673
fix
frostebite 258e40d
fix: k3d/LocalStack networking - use shared Docker network and contai…
frostebite 33fccb8
fix: rename LOCALSTACK_HOST to K8S_LOCALSTACK_HOST to avoid awslocal …
frostebite fcf2d80
fix: skip AWS environment test (requires LocalStack Pro for full Clou…
frostebite fdb7286
fix: remove EFS from AWS stack - use S3 caching for storage instead
frostebite 84e123c
Revert "fix: remove EFS from AWS stack - use S3 caching for storage i…
frostebite 43f346b
fix: enable EFS and all AWS services in LocalStack, re-enable AWS env…
frostebite d318481
fix: add secretsmanager and other services to LocalStack
frostebite 3f7c332
fix: add aws-local mode - validates AWS CloudFormation templates, exe…
frostebite 46b16bb
fix: add rclone integration test with LocalStack S3 backend
frostebite 682d2db
chore: remove temp log files and debug artifacts
frostebite 4393f04
fix: address PR review feedback from GabLeRoux
frostebite 08eabcf
integrate PR #686
frostebite e6b14c7
integrate PR #686
frostebite c9af2e7
lint fix
frostebite 31e08ae
fix: use /bin/sh for Alpine-based images (rclone/rclone) in docker pr…
frostebite 99365c6
fix: lint issues
frostebite 1971860
fix: restore GitHub API workflow_id convention and getCheckStatus method
frostebite 89733f1
revert: remove unrelated changes to docker.ts, github.ts, image-tag.t…
frostebite b5b1382
fix: use /bin/sh for Alpine-based images (rclone/rclone) in docker pr…
frostebite 88941c4
fix: fetch only specific PR ref instead of all PR refs
frostebite ac14317
chore: remove cleanup.yml workflow
frostebite fb60126
chore: remove redundant cloud-runner-integrity-localstack.yml
frostebite File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🛠️ Refactor suggestion
Extend override to cover Jest config files and fix CI lint errors.
CI reports import/no-commonjs and filename rule violations in jest.ci.config.js. Add those files to the override and disable the filename rule for them.
Apply this diff:
📝 Committable suggestion
🤖 Prompt for AI Agents