Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
104 commits
Select commit Hold shift + click to select a range
c02f0a5
Run builds and tests against Altinity's CI/CD infrastructure
Enmk Oct 26, 2023
9f5c023
Fixed some CI/CD issues
Enmk Oct 27, 2023
faa2391
Fixed BuilderDebAarch64
Enmk Oct 27, 2023
92ff59c
Fixed BuilderDebRelease
Enmk Oct 27, 2023
f6de8f3
Merge pull request #318 from Altinity/customizations/23.8.4-draft
Enmk Nov 7, 2023
d8c300d
Merge remote-tracking branch 'altinity/customizations/23.8.4' into cu…
Enmk Nov 7, 2023
0d43a2b
Fixed merge issue
Enmk Nov 7, 2023
d8885c2
Merge branch 'customizations/23.8.5' into customizations/23.8.8
Enmk Nov 29, 2023
f456018
Fixed regression tests staring jobs, which was maimed during the merge
Enmk Nov 29, 2023
77f4c8d
Fixing workflows
Enmk Nov 29, 2023
7583c2d
Attempt to set multiple runner tags
Enmk Nov 30, 2023
2cdae52
Fixing version check in build_check.py
Enmk Nov 30, 2023
04e33bc
Simplified multi-value 'runner_type'
Enmk Nov 30, 2023
0f58fa1
Fixed build_check.py
Enmk Nov 30, 2023
f5b37f8
Removing whitespace from input runner tag string.
Enmk Nov 30, 2023
4ee2017
A bit of debugging for runner tags
Enmk Nov 30, 2023
2e968da
Larger Builder Instances
MyroTk Nov 30, 2023
02723ae
Update reusable_build.yml
MyroTk Dec 1, 2023
20fad99
Update reusable_test.yml
MyroTk Dec 1, 2023
8b584a9
Update release_branches.yml
MyroTk Dec 1, 2023
33b5ac1
Update reusable_build.yml
MyroTk Dec 1, 2023
3afdbac
Update reusable_test.yml
MyroTk Dec 1, 2023
4aef2eb
Update release_branches.yml
MyroTk Dec 1, 2023
90e1ed5
Update reusable_build.yml
MyroTk Dec 1, 2023
862bd23
Update reusable_test.yml
MyroTk Dec 1, 2023
e9fe8fc
Update reusable_build.yml
MyroTk Dec 1, 2023
282c310
Update reusable_test.yml
MyroTk Dec 1, 2023
aa1be57
Update reusable_build.yml
MyroTk Dec 1, 2023
c3bbdf8
Update release_branches.yml
MyroTk Dec 1, 2023
02d291a
Merge pull request #333 from Altinity/MyroTk-patch-1
Enmk Dec 4, 2023
7af6e9d
Using docker registry for pulling all test images
Enmk Dec 7, 2023
885f0a7
Update reusable_test.yml
Enmk Dec 7, 2023
faa9808
Common docker setup action, to use caching docker registry everywhere
Enmk Dec 10, 2023
98a6086
Update action.yml
Enmk Dec 10, 2023
f8a6811
Update action.yml
Enmk Dec 10, 2023
ddb289f
Update action.yml
Enmk Dec 10, 2023
0ca958d
No docker proxy for DockerHubPush-X jobs
Enmk Dec 10, 2023
503ba50
Attempt to docker login from docker_setup/action.yml
Enmk Dec 11, 2023
2db2b29
Attempt to do log in sooner
Enmk Dec 11, 2023
ba0de7f
A bit more logging
Enmk Dec 11, 2023
94f8a74
Alternative way to pass secrets
Enmk Dec 11, 2023
6c5828a
Not using registry + a bit more logging for when we are building dock…
Enmk Dec 11, 2023
88d7ea8
Fixed typo + more logging
Enmk Dec 11, 2023
94f4b13
Attempt to fix integration tests
Enmk Dec 11, 2023
f9c75b3
Minor fixes and a bit more logging
Enmk Dec 12, 2023
cbc3251
Specified versions of installed software
Enmk Dec 12, 2023
383b4e2
More pinned versions
Enmk Dec 12, 2023
24e6957
Updated pinned versions so images can be actually built
Enmk Dec 13, 2023
8fec23f
Fixes to pinned versions
Enmk Dec 13, 2023
126ef63
Unpinned version of iproute2 for altinityinfra/integration-helper
Enmk Dec 13, 2023
e27082a
set alpine:3.18 as base for altinityinfra/integration-helper
Enmk Dec 13, 2023
3d58c7e
Merge pull request #336 from Altinity/fix_integration_tests_dependenc…
Enmk Dec 13, 2023
2eec9e0
Caching pre-pulled docker images for later re-use by integration tests
Enmk Dec 14, 2023
1806956
Fixed type of get_json_params_dict parameter
Enmk Dec 14, 2023
72c29d0
Not using ppa:ubuntu-toolchain-r/test since it is not ubuntu 20 anymore
Enmk Dec 14, 2023
cfa132c
Merge pull request #335 from Altinity/use_caching_docker_registry_in_…
Enmk Dec 14, 2023
4bdf579
Removed lengthy debug output
Enmk Dec 14, 2023
d77fac5
Attempt to fix failing tests by reducing batch size and reducing para…
Enmk Dec 5, 2023
0fdc699
Reduce parallelism on each re-run to improve chancess of test passing
Enmk Dec 15, 2023
5103757
Merge pull request #334 from Altinity/23.8.8-attempt-test_merge_tree_…
Enmk Dec 15, 2023
9a0e98e
Passing Path object instead of str, as expected
Enmk Dec 15, 2023
363a1cc
Update release_branches.yml
MyroTk Dec 18, 2023
b0bb1b2
Not building images required for integration tests on ARM64
Enmk Dec 18, 2023
df8def5
Less strict version pinning for dependencies
Enmk Dec 18, 2023
2293bc8
Merge pull request #337 from Altinity/23.8.8_fix_SignRelease
Enmk Dec 18, 2023
b99d3cf
Merge branch 'customizations/23.8.8' into 23.8_docker_push
Enmk Dec 18, 2023
dad3408
Update release_branches.yml
Enmk Dec 18, 2023
109c6e7
getting regression to run again
MyroTk Dec 18, 2023
5b2316d
moving workflow
MyroTk Dec 18, 2023
1c4c9aa
Update release_branches.yml
MyroTk Dec 19, 2023
cbc0960
Update ci-runner.py
MyroTk Dec 19, 2023
1cb992e
Update release_branches.yml
MyroTk Dec 19, 2023
092801e
extract zip
MyroTk Dec 19, 2023
f197bc5
Update docker_server.py
MyroTk Dec 19, 2023
925730c
debug artifact extract
MyroTk Dec 19, 2023
96ba525
Update docker_server.py
MyroTk Dec 19, 2023
ace4873
enable arm
MyroTk Dec 19, 2023
70a7c80
Update docker_server.py
MyroTk Dec 19, 2023
7aba012
Update runners
MyroTk Dec 19, 2023
f7019dc
update arm hash
MyroTk Dec 19, 2023
832dde5
retrigger build
MyroTk Dec 19, 2023
dd8ef4b
increase timeouts and fix artifact upload
MyroTk Dec 20, 2023
dc047a7
hash update
MyroTk Dec 20, 2023
f75a0eb
Merge pull request #340 from Altinity/23.8_integration_retries
Enmk Dec 20, 2023
dddec6b
Merge pull request #339 from Altinity/23.8_docker_push
Enmk Dec 20, 2023
86bdd4a
update artifact path
MyroTk Dec 20, 2023
c64b2d4
Merge branch 'customizations/23.8.8' into 23.8.8_regression
MyroTk Dec 20, 2023
6cbb39a
remove comment
MyroTk Dec 20, 2023
6ab51af
work around to get correct commit sha for artifact upload
MyroTk Dec 20, 2023
9b330ab
Merge pull request #338 from Altinity/23.8.8_regression
Enmk Dec 20, 2023
4142285
Merge pull request #56030 from azat/disks/least_used-fix
serxa Oct 30, 2023
e5c997e
Merge pull request #54905 from nickitat/fix_key_analysis_merge_engine
KochetovNicolai Nov 9, 2023
90093ea
Cherry-picked merge-commit of ClickHouse#54934
nickitat Sep 28, 2023
f42bb1c
Merge pull request #344 from Altinity/backports/23.8/56030_fix_JBOD_i…
Enmk Dec 21, 2023
9dbb6d7
Merge pull request #57395 from ClickHouse/backport/23.8/56493
evillique Dec 1, 2023
0e809b0
Merge pull request #341 from Altinity/backports/23.8/54905_Fix_key_an…
Enmk Dec 22, 2023
95bb58a
Merge pull request #345 from Altinity/backport/23.8/57395_fix_alter_c…
Enmk Dec 22, 2023
d698625
Merge pull request #343 from Altinity/backports/23.8/54934_fix_FINAL_…
Enmk Dec 22, 2023
ecd52ec
Merge pull request #57822 from azat/kafka-disable-stat
alexey-milovidov Dec 14, 2023
37e99eb
Merge pull request #346 from Altinity/backport/23.8/57822_disable_sys…
Enmk Dec 22, 2023
1985a21
Merge pull request #55172 from amosbird/fix-55106
alexey-milovidov Sep 30, 2023
3d7b4f9
Merge pull request #342 from Altinity/backports/23.8/55172_fix_partit…
Enmk Dec 25, 2023
166cd20
Using 'gh-data' instead of 'default' for CI/CD events reporting
Enmk Dec 25, 2023
193c1f9
Merge pull request #347 from Altinity/fix_events_db
Enmk Dec 25, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
38 changes: 38 additions & 0 deletions .github/actions/docker_setup/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
name: Docker setup
description: Setup docker
inputs:
nested_job:
description: the fuse for unintended use inside of the reusable callable jobs
default: true
type: boolean
DOCKER_USERNAME:
description: username for the dockerhub login
required: true
type: string
DOCKER_PASSWORD:
description: password for the dockerhub login
required: true
type: string
runs:
using: "composite"
steps:
- name: Docker IPv6 configuration
shell: bash
run: |
# make sure docker uses proper IPv6 config
sudo touch /etc/docker/daemon.json
sudo chown ubuntu:ubuntu /etc/docker/daemon.json
sudo cat <<EOT > /etc/docker/daemon.json
{
"ipv6": true,
"fixed-cidr-v6": "2001:3984:3989::/64"
}
EOT
sudo chown root:root /etc/docker/daemon.json
sudo systemctl restart docker
sudo systemctl status docker
- name: Docker login
shell: bash
run: |
docker login -u ${{ inputs.DOCKER_USERNAME }} -p ${{ inputs.DOCKER_PASSWORD }}
docker info
22 changes: 22 additions & 0 deletions .github/retry.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
#!/bin/bash
# Execute command until exitcode is 0 or
# maximum number of retries is reached
# Example:
# ./retry <retries> <delay> <command>
retries=$1
delay=$2
command="${@:3}"
exitcode=0
try=0
until [ "$try" -ge $retries ]
do
echo "$command"
eval "$command"
exitcode=$?
if [ $exitcode -eq 0 ]; then
break
fi
try=$((try+1))
sleep $2
done
exit $exitcode
6 changes: 3 additions & 3 deletions .github/workflows/backport_branches.yml
Original file line number Diff line number Diff line change
Expand Up @@ -173,13 +173,13 @@ jobs:
clear-repository: true
fetch-depth: 0 # It MUST BE THE SAME for all dependencies and the job itself
filter: tree:0
- name: Check docker clickhouse/clickhouse-server building
- name: Check docker altinityinfra/clickhouse-server building
run: |
cd "$GITHUB_WORKSPACE/tests/ci"
python3 docker_server.py --release-type head --no-push \
--image-repo clickhouse/clickhouse-server --image-path docker/server
--image-repo altinityinfra/clickhouse-server --image-path docker/server
python3 docker_server.py --release-type head --no-push \
--image-repo clickhouse/clickhouse-keeper --image-path docker/keeper
--image-repo altinityinfra/clickhouse-keeper --image-path docker/keeper
- name: Cleanup
if: always()
run: |
Expand Down
45 changes: 0 additions & 45 deletions .github/workflows/cherry_pick.yml

This file was deleted.

140 changes: 0 additions & 140 deletions .github/workflows/docs_check.yml

This file was deleted.

29 changes: 0 additions & 29 deletions .github/workflows/jepsen.yml

This file was deleted.

6 changes: 3 additions & 3 deletions .github/workflows/master.yml
Original file line number Diff line number Diff line change
Expand Up @@ -233,13 +233,13 @@ jobs:
clear-repository: true
fetch-depth: 0 # It MUST BE THE SAME for all dependencies and the job itself
filter: tree:0
- name: Check docker clickhouse/clickhouse-server building
- name: Check docker altinityinfra/clickhouse-server building
run: |
cd "$GITHUB_WORKSPACE/tests/ci"
python3 docker_server.py --release-type head \
--image-repo clickhouse/clickhouse-server --image-path docker/server
--image-repo altinityinfra/clickhouse-server --image-path docker/server
python3 docker_server.py --release-type head \
--image-repo clickhouse/clickhouse-keeper --image-path docker/keeper
--image-repo altinityinfra/clickhouse-keeper --image-path docker/keeper
- name: Cleanup
if: always()
run: |
Expand Down
Loading