Parallel executions of aws-deployment-framework-bootstrap-pipeline leads to failure in CodeBuild #270
Description
Description
When a change is made to CodeCommit:aws-deployment-framework-bootstrap/* multiple times in a short period of time, it leads to an error inside CodeBuild:aws-deployment-framework-base-templates.
Info
- ADF version: 3.0.6
- Reproducible: Always
Expected Behavior
CodeBuild should run multiple times without any issue. (1. run with the first CodeCommit change, 2. run with the second change, ...)
Steps to reproduce
- Edit any file inside CodeCommit:aws-deployment-framework-bootstrap and push it.
- Do an edit+push again (within 1-2 minutes)
- Go to CodeBuild:aws-deployment-framework-base-templates and you can see the error:
CLIENT_ERROR: NoSuchKey: The specified key does not exist. status code: 404,
request id: 2C756B0562D8D657,
host id: MY+Nw7YKRaPmZpHizWSx0P5F7luKZXChIccEOvBxWQHgDWGvCSKy7/ZOhwQIVuEiETzDk2qN3X0=
for primary source and source version
arn:aws:s3:::serverlessrepo-aws-deplo-bootstraptemplatesbucket-[...]/aws-deployment-frame/TemplateSo/[...]
Reason
- ADF itself re-uses the CodePipeline/CodeBuild S3 artifact bucket
- Additionally CodeBuild will remove all of the CodePipeline Artifacts
Solution
Use a separate ArtifactBucket for CodePipeline and for CodeBuild to store its created data.