Skip to content

dataflow: new minimal gpu samples #6096

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
leahecole merged 114 commits into from
Jul 13, 2021
Merged

dataflow: new minimal gpu samples #6096

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
114 commits
Select commit Hold shift + click to select a range
f2bacd1
dataflow: minimal gpu examples
Jun 7, 2021
7bb9e48
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 7, 2021
d8bba19
added tests
Jun 7, 2021
2ebd8b7
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 7, 2021
ed2d91d
update dockerignore and cloudignore
Jun 7, 2021
7969369
remove old config
Jun 7, 2021
d34a2ca
update header year
Jun 7, 2021
193ce0e
removed unused import
Jun 7, 2021
abcbaae
add test
Jun 7, 2021
f6af338
make image name unique
Jun 7, 2021
ba72e54
fix image name
Jun 8, 2021
ec4bcde
fix resource name issues
Jun 9, 2021
a9dd1bc
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 9, 2021
d24fbf9
fix lint issues
Jun 9, 2021
d0593cb
fix underscore_name
Jun 9, 2021
07a4b44
wait for jobs
Jun 9, 2021
17258d4
fix test requirements
Jun 9, 2021
bea1b05
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 9, 2021
dabb8ff
fix image prefix
Jun 9, 2021
ffa0476
get job status for wait
Jun 10, 2021
07d1395
use correct region
Jun 10, 2021
6c87851
make jobs list not region dependent
Jun 10, 2021
e54accd
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 10, 2021
0d76f0b
use uuid for image tags
Jun 10, 2021
ab9d039
update title
Jun 10, 2021
3781636
fix run command
Jun 10, 2021
f1bd64e
remove region from job get call
Jun 10, 2021
6e3a4f6
launch jobs from fixtures
Jun 10, 2021
b66bf1e
fix resource names
Jun 15, 2021
45ba754
use unique images
Jun 15, 2021
108f932
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 15, 2021
c452cc4
fix lint issues
Jun 15, 2021
67fa556
pass --no-source when running the job
Jun 15, 2021
7aabf8b
more logging and changed region
Jun 15, 2021
5f58ba7
simplified type hints
Jun 15, 2021
c59bbe6
get all jobs and update wait job status
Jun 15, 2021
9ae84e7
update header years
Jun 15, 2021
9532073
tune logging
Jun 16, 2021
10214b5
fix tests
Jun 16, 2021
41501a9
made logging more explicit
Jun 16, 2021
3c68838
use disk_size_gb
Jun 16, 2021
2081cad
use larger disk_size_gb for landsat
Jun 16, 2021
2901e8a
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 16, 2021
314ffbd
list all jobs
Jun 16, 2021
83de548
wait before querying
Jun 16, 2021
c1ee4e9
include python version on resource names
Jun 16, 2021
d0c4533
update beam version
Jun 16, 2021
8a10eb2
use 30m timeout
Jun 16, 2021
35775b1
more debugging and increase waiting time
Jun 16, 2021
9484ce9
update bq query
Jun 16, 2021
d94d688
use shorter flag name alias
Jun 16, 2021
1887870
made logs clearer
Jun 16, 2021
afdfa0f
fix typo
Jun 16, 2021
8d50016
add more logging
Jun 16, 2021
5880ce9
wait longer for table to be created
Jun 16, 2021
68d3ad5
remove spurious f-string
Jun 16, 2021
958a56a
add disk size
Jun 16, 2021
1f47a92
updated beam version
Jun 17, 2021
84759a4
add comments
Jun 17, 2021
d119688
add missing fixture
Jun 17, 2021
fe197ae
decrease waiting time
Jun 17, 2021
303e009
increase waiting time
Jun 17, 2021
748345f
provide staging location
Jun 17, 2021
226d642
drain before cancel
Jun 18, 2021
ba1caa7
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 18, 2021
16e5d8e
adjust wait time
Jun 18, 2021
aa29c54
adjust timeout
Jun 18, 2021
57eb9ab
adjust timeout
Jun 18, 2021
3104e63
improve error messages
Jun 18, 2021
60372bb
small refactorings
Jun 21, 2021
11b67ba
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 21, 2021
688865f
add missing fixture
Jun 21, 2021
230fa94
updated timeout
Jun 23, 2021
c7c6aa4
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 23, 2021
a341327
containerize gpu tests
Jun 23, 2021
8fd496c
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 23, 2021
33a9f09
remove unused import
Jun 23, 2021
d9f776a
reverted streaming-beam changes
Jun 23, 2021
f9608fc
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 23, 2021
25303ee
updated image versions
Jun 23, 2021
568e9fe
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 23, 2021
fdb2610
restore old sample to avoid breaking docs
Jun 23, 2021
52ad071
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 23, 2021
5fc27b4
update copyright year
Jun 23, 2021
1f005ae
fix lint issues
Jun 23, 2021
ea83446
renamed test file
Jun 24, 2021
83622c0
update beam version
Jun 24, 2021
a8ba462
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 24, 2021
3765572
renamed test files
Jun 24, 2021
2c837c9
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 24, 2021
16f207b
adjust to conftest behaving differently with tests in current directory
Jun 24, 2021
d116333
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 24, 2021
51fdb72
moved new samples to another directory
Jun 25, 2021
0ec23ca
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 25, 2021
50f3d44
simplified instructions
Jun 25, 2021
9763997
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 25, 2021
085feeb
add gcloudignore to reduce test time
Jun 25, 2021
85d4305
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 25, 2021
cb6ee04
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jun 28, 2021
dccd745
reset gpu-workers entirely
Jun 28, 2021
cfd2d6b
Merge branch 'master' into dataflow-gpu
Jun 30, 2021
b1845a2
Merge branch 'master' into dataflow-gpu
Jun 30, 2021
7ccbdca
test in a single Python version
Jul 1, 2021
b658904
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jul 1, 2021
5142c9e
run subprocess as daemon
Jul 12, 2021
7caca19
update beam version
Jul 12, 2021
ac98d54
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jul 12, 2021
e687681
install g++ to compile google-cloud-profiler
Jul 12, 2021
9c11b46
fix build dependencies
Jul 13, 2021
cb5b4dd
fix build dependencies
Jul 13, 2021
a503021
fix build dependencies
Jul 13, 2021
0c8c2c1
adjust timeout
Jul 13, 2021
5199b36
Merge branch 'master' of github.com:GoogleCloudPlatform/python-docs-s…
Jul 13, 2021
1d287e1
Merge branch 'master' into dataflow-gpu
Jul 13, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion dataflow/flex-templates/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +0,0 @@

Loading