dataflow: new minimal gpu samples#6096

Merged

leahecole merged 114 commits intoGoogleCloudPlatform:masterfrom

davidcavazos:dataflow-gpu

Jul 13, 2021

Commits on Jun 7, 2021

dataflow: minimal gpu examples
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
added tests
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
update dockerignore and cloudignore
David Cavazos
committed
remove old config
David Cavazos
committed
update header year
David Cavazos
committed
removed unused import
David Cavazos
committed
add test
David Cavazos
committed
make image name unique
David Cavazos
committed

Commits on Jun 8, 2021

fix image name
David Cavazos
committed

Commits on Jun 9, 2021

fix resource name issues
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
fix lint issues
David Cavazos
committed
fix underscore_name
David Cavazos
committed
wait for jobs
David Cavazos
committed
fix test requirements
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
fix image prefix
David Cavazos
committed

Commits on Jun 10, 2021

get job status for wait
David Cavazos
committed
use correct region
David Cavazos
committed
make jobs list not region dependent
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
use uuid for image tags
David Cavazos
committed
update title
David Cavazos
committed
fix run command
David Cavazos
committed
remove region from job get call
David Cavazos
committed
launch jobs from fixtures
David Cavazos
committed

Commits on Jun 15, 2021

fix resource names
David Cavazos
committed
use unique images
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
fix lint issues
David Cavazos
committed
pass --no-source when running the job
David Cavazos
committed
more logging and changed region
David Cavazos
committed
simplified type hints
David Cavazos
committed
get all jobs and update wait job status
David Cavazos
committed
update header years
David Cavazos
committed

Commits on Jun 16, 2021

tune logging
David Cavazos
committed
fix tests
David Cavazos
committed
made logging more explicit
David Cavazos
committed
use disk_size_gb
David Cavazos
committed
use larger disk_size_gb for landsat
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
list all jobs
David Cavazos
committed
wait before querying
David Cavazos
committed
include python version on resource names
David Cavazos
committed
update beam version
David Cavazos
committed
use 30m timeout
David Cavazos
committed
more debugging and increase waiting time
David Cavazos
committed
update bq query
David Cavazos
committed
use shorter flag name alias
David Cavazos
committed
made logs clearer
David Cavazos
committed
fix typo
David Cavazos
committed
add more logging
David Cavazos
committed
wait longer for table to be created
David Cavazos
committed
remove spurious f-string
David Cavazos
committed
add disk size
David Cavazos
committed

Commits on Jun 17, 2021

updated beam version
David Cavazos
committed
add comments
David Cavazos
committed
add missing fixture
David Cavazos
committed
decrease waiting time
David Cavazos
committed
increase waiting time
David Cavazos
committed
provide staging location
David Cavazos
committed

Commits on Jun 18, 2021

drain before cancel
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
adjust wait time
David Cavazos
committed
adjust timeout
David Cavazos
committed
adjust timeout
David Cavazos
committed
improve error messages
David Cavazos
committed

Commits on Jun 21, 2021

small refactorings
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
add missing fixture
David Cavazos
committed

Commits on Jun 23, 2021

updated timeout
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
containerize gpu tests
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
remove unused import
David Cavazos
committed
reverted streaming-beam changes
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
updated image versions
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
restore old sample to avoid breaking docs
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
update copyright year
David Cavazos
committed
fix lint issues
David Cavazos
committed

Commits on Jun 24, 2021

Commits on Jun 25, 2021

moved new samples to another directory
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
simplified instructions
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
add gcloudignore to reduce test time
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed

Commits on Jun 28, 2021

Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
reset gpu-workers entirely
David Cavazos
committed

Commits on Jun 30, 2021

Merge branch 'master' into dataflow-gpu
David Cavazos
authored
Merge branch 'master' into dataflow-gpu
David Cavazos
authored

Commits on Jul 1, 2021

test in a single Python version
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed

Commits on Jul 12, 2021

run subprocess as daemon
David Cavazos
committed
update beam version
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
install g++ to compile google-cloud-profiler
David Cavazos
committed

Commits on Jul 13, 2021

fix build dependencies
David Cavazos
committed
fix build dependencies
David Cavazos
committed
fix build dependencies
David Cavazos
committed
adjust timeout
David Cavazos
committed
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-samples into dataflow-gpu
David Cavazos
committed
Merge branch 'master' into dataflow-gpu
David Cavazos
authored