Skip to content

Test independent cluster CI #549

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
charlesbluca wants to merge 7 commits into from
Closed

Test independent cluster CI #549

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
aa3e208
test independent cluster ~CI
charlesbluca May 23, 2022
dc80d7f
Pin pyarrow to 7
charlesbluca May 23, 2022
1ee2976
Apply suggestions from code review
galipremsagar May 23, 2022
a67229f
Pin pyarrow to specific build
charlesbluca May 23, 2022
130b302
Add compilers to testing environments
charlesbluca May 23, 2022
5ad0f2c
Remove gcc pinning
charlesbluca May 23, 2022
0424e56
Unpin pyarrow version
charlesbluca May 23, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/cluster-upstream.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@ services:
command: dask-worker dask-scheduler:8786
environment:
USE_MAMBA: "true"
EXTRA_CONDA_PACKAGES: "dask/label/dev::dask pyarrow>1.0.0" # required for parquet IO
EXTRA_CONDA_PACKAGES: "dask/label/dev::dask pyarrow>=1.0.0" # required for parquet IO
volumes:
- /tmp:/tmp
2 changes: 1 addition & 1 deletion .github/cluster.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,6 @@ services:
command: dask-worker dask-scheduler:8786
environment:
USE_MAMBA: "true"
EXTRA_CONDA_PACKAGES: "pyarrow>1.0.0" # required for parquet IO
EXTRA_CONDA_PACKAGES: "pyarrow>=1.0.0" # required for parquet IO
volumes:
- /tmp:/tmp
6 changes: 5 additions & 1 deletion continuous_integration/environment-3.10-jdk11-dev.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ dependencies:
- pre-commit>=2.11.1
- prompt_toolkit>=3.0.8
- psycopg2>=2.9.1
- pyarrow>=0.15.1
- pyarrow>=1.0.0
- pygments>=2.7.1
- pyhive>=0.6.4
- pytest-cov>=2.10.1
Expand All @@ -39,5 +39,9 @@ dependencies:
- triad>=0.5.4
- tzlocal>=2.1
- uvicorn>=0.11.3
- c-compiler
- cxx-compiler
- gcc_linux-64
- sysroot_linux-64==2.17
- pip:
- fugue[sql]>=0.5.3
6 changes: 5 additions & 1 deletion continuous_integration/environment-3.10-jdk8-dev.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ dependencies:
- pre-commit>=2.11.1
- prompt_toolkit>=3.0.8
- psycopg2>=2.9.1
- pyarrow>=0.15.1
- pyarrow>=1.0.0
- pygments>=2.7.1
- pyhive>=0.6.4
- pytest-cov>=2.10.1
Expand All @@ -39,5 +39,9 @@ dependencies:
- triad>=0.5.4
- tzlocal>=2.1
- uvicorn>=0.11.3
- c-compiler
- cxx-compiler
- gcc_linux-64
- sysroot_linux-64==2.17
- pip:
- fugue[sql]>=0.5.3
6 changes: 5 additions & 1 deletion continuous_integration/environment-3.8-jdk11-dev.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ dependencies:
- pre-commit>=2.11.1
- prompt_toolkit>=3.0.8
- psycopg2>=2.9.1
- pyarrow>=0.15.1
- pyarrow>=1.0.0
- pygments>=2.7.1
- pyhive>=0.6.4
- pytest-cov>=2.10.1
Expand All @@ -39,5 +39,9 @@ dependencies:
- triad>=0.5.4
- tzlocal>=2.1
- uvicorn>=0.11.3
- c-compiler
- cxx-compiler
- gcc_linux-64
- sysroot_linux-64==2.17
- pip:
- fugue[sql]>=0.5.3
6 changes: 5 additions & 1 deletion continuous_integration/environment-3.8-jdk8-dev.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ dependencies:
- pre-commit>=2.11.1
- prompt_toolkit>=3.0.8
- psycopg2>=2.9.1
- pyarrow>=0.15.1
- pyarrow>=1.0.0
- pygments>=2.7.1
- pyhive>=0.6.4
- pytest-cov>=2.10.1
Expand All @@ -39,5 +39,9 @@ dependencies:
- triad>=0.5.4
- tzlocal>=2.1
- uvicorn>=0.11.3
- c-compiler
- cxx-compiler
- gcc_linux-64
- sysroot_linux-64==2.17
- pip:
- fugue[sql]>=0.5.3
7 changes: 5 additions & 2 deletions continuous_integration/environment-3.9-jdk11-dev.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ dependencies:
- pre-commit>=2.11.1
- prompt_toolkit>=3.0.8
- psycopg2>=2.9.1
- pyarrow>=0.15.1
- pyarrow>=1.0.0
- pygments>=2.7.1
- pyhive>=0.6.4
- pytest-cov>=2.10.1
Expand All @@ -39,6 +39,9 @@ dependencies:
- triad>=0.5.4
- tzlocal>=2.1
- uvicorn>=0.11.3
- cfn-lint>=0.4.0
- c-compiler
- cxx-compiler
- gcc_linux-64
- sysroot_linux-64==2.17
- pip:
- fugue[sql]>=0.5.3
6 changes: 5 additions & 1 deletion continuous_integration/environment-3.9-jdk8-dev.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ dependencies:
- pre-commit>=2.11.1
- prompt_toolkit>=3.0.8
- psycopg2>=2.9.1
- pyarrow>=0.15.1
- pyarrow>=1.0.0
- pygments>=2.7.1
- pyhive>=0.6.4
- pytest-cov>=2.10.1
Expand All @@ -39,5 +39,9 @@ dependencies:
- triad>=0.5.4
- tzlocal>=2.1
- uvicorn>=0.11.3
- c-compiler
- cxx-compiler
- gcc_linux-64
- sysroot_linux-64==2.17
- pip:
- fugue[sql]>=0.5.3