23.3.19 Altinity Stable

Changes compared to upstream's v23.3.19.32-lts

Bug fixes

• Fix key condition on duplicate primary keys (ClickHouse#48838 by @amosbird via #275 )
• Fix excessive memory usage for FINAL (ClickHouse#50429 by @ azat via #307)
• Fixed DNS-related crash (ClickHouse#52634 by @arthurpassos via #295)
• Fix parquet array inconsistent offsets (ClickHouse#54370 by @arthurpassos via #303)
• Fixed rare bug when we produced invalid read ranges for queries with FINAL. Resulted in Cannot read out of marks range exception (ClickHouse#54934 by @nickitat via #313)
• Fixed reading from sparse columns after changing setting ratio_of_defaults_for_sparse_serialization back to 1.0 and restarting the server. (ClickHouse#49660 by @CurtizJ via #314)
• Fix incorrect free space accounting for least_used JBOD policy (ClickHouse#56030 by @azat via #365)
• Fixes race condition, prevents application crash (ClickHouse#52623 by @hanfei1991 via #366)
• Fixed leaking loggers in some cases, like creating and dropping tables (ClickHouse#58831, ClickHouse#59273 by @kitaisreal via #356)
• Fix deadlock in LDAP assigned role update for non-existing ClickHouse roles (ClickHouse#55119 by @jmaicher, ClickHouse#56544 by @jmaicher via #364)

Performance improvement

• Do not build sets for skip indexes if they are not used (ClickHouse#48299 by @CurtizJ via #276)

Improvement

• Disabled unsafe "compile_expressions" setting by default (ClickHouse#51368 by @alexey-milovidov via #306)
• Row policy for database (ClickHouse#47640 by @ilejn via #300)

Build/Testing/Packaging Improvement

• Bring back DNS tests (ClickHouse#53286 - @arthurpassos via #296)
• Made builds and tests possible in Altinity's infrastructure
• Support of Aarch64 builds (#311)
  • building Aarch64 binaries
  • multi-arch docker containers (Amd64, Aarch64)
  • running stateles, stateful tests against Aarch64
  • running clickhouse-regression tests against Aarch64

upstream ClickHouse changes between v23.3.19.32-lts (c4d4ca8ec02) and v23.3.13.6-lts (25635e27551)

Improvement

• Fix transfer query to MySQL compatible query. (ClickHouse#56456 by flynn via ClickHouse#58489).
• There was a potential vulnerability in previous ClickHouse versions: if a user has connected and unsuccessfully tried to authenticate with the "interserver secret" method, the server didn't terminate the connection immediately but continued to receive and ignore the leftover packets from the client. While these packets are ignored, they are still parsed, and if they use a compression method with another known vulnerability, it will lead to exploitation of it without authentication. This issue was found with [ClickHouse Bug Bounty Program] by https://twitter.com/malacupa. (ClickHouse#56794 by Alexey Milovidov via ClickHouse#56928).
• Handle sigabrt case when getting PostgreSQl table structure with empty array. (ClickHouse#57618 by Mikhail Kot via ClickHouse#57653).

Build/Testing/Packaging Improvement

• Fix strange additional QEMU logging after ClickHouse#47151, see https://s3.amazonaws.com/clickhouse-test-reports/50078/a4743996ee4f3583884d07bcd6501df0cfdaa346/stateless_tests__release__databasereplicated__[3_4].html. (ClickHouse#50442 by Mikhail f. Shiryaev via ClickHouse#54312).
• If the database is already initialized, it doesn't need to be initialized again upon subsequent launches. This can potentially fix the issue of infinite container restarts when the database fails to load within 1000 attempts (relevant for very large databases and multi-node setups). (ClickHouse#50724 by Alexander Nikolaev via ClickHouse#55671).
• Resource with source code including submodules is built in Darwin special build task. It may be used to build ClickHouse without checkouting submodules. (ClickHouse#51435 by Ilya Yatsishin via ClickHouse#55391).
• Enrich changed_images.json with the latest tag from master for images that are not changed in the pull request. (ClickHouse#54369 by János Benjamin Antal via ClickHouse#54703).
• We build and upload them for every push, which isn't worth it. (ClickHouse#54675 by Mikhail f. Shiryaev via ClickHouse#54679).
• Fix integration check python script to use gh api url - Add Readme for CI tests. (ClickHouse#55716 by Max K. via ClickHouse#55734).
• Check sha512 for tgz; use a proper repository for keeper; write only filenames to TGZ.sha512 files for tarball packages. Prerequisite for ClickHouse#31473. (ClickHouse#55717 by Mikhail f. Shiryaev via ClickHouse#55829).
• Do not fetch changed submodules in the builder container. (ClickHouse#56689 by Mikhail f. Shiryaev via ClickHouse#56731).
• There was an attempt to have the proper listing in ClickHouse#44311, but the fix itself was in the wrong place, so it's still broken. See an example. (ClickHouse#56989 by Mikhail f. Shiryaev via ClickHouse#57019).
• Fix issue caught in docker-library/official-images#15846. (ClickHouse#57571 by Mikhail f. Shiryaev via ClickHouse#57580).
• Pin rust version to fix GLIBC compatibility check. (ClickHouse#55788 by Mikhail f. Shiryaev).

Bug Fix (user-visible misbehavior in an official stable release)

• Fix parameterized view with cte and multiple usage (ClickHouse#52328 by SmitaRKulkarni).
• Check recursion depth in OptimizedRegularExpression (ClickHouse#52451 by Alexey Milovidov).
• Fix lightweight delete after drop of projection (ClickHouse#52517 by Anton Popov).
• Fix sorting of sparse columns with large limit (ClickHouse#52827 by Anton Popov).
• Fix adding sub-second intervals to DateTime (ClickHouse#53309 by Michael Kolupaev).
• Fix: allow IPv6 for bloom filter (ClickHouse#54200 by Yakov Olkhovskiy).
• Check for overflow before addition in analysisOfVariance function (ClickHouse#54385 by Antonio Andelic).
• Fix aggregate projections with normalized states (ClickHouse#54480 by Amos Bird).
• Fix possible parsing error in WithNames formats with disabled input_format_with_names_use_header (ClickHouse#54513 by Kruglov Pavel).
• Fix: avoid using regex match, possibly containing alternation, as a key condition. (ClickHouse#54696 by Yakov Olkhovskiy).
• Fix "Invalid number of rows in Chunk" in MaterializedPostgreSQL (ClickHouse#54844 by Kseniia Sumarokova).
• Prevent attaching parts from tables with different projections or indices (ClickHouse#55062 by János Benjamin Antal).
• Fix bug with inability to drop detached partition in replicated merge tree on top of S3 without zero copy (ClickHouse#55309 by alesapin).
• Fix trash optimization (up to a certain extent) (ClickHouse#55353 by Alexey Milovidov).
• Fix parsing of arrays in cast operator (ClickHouse#55417 by Anton Popov).
• Fix crash in QueryNormalizer with cyclic aliases (ClickHouse#55602 by vdimir).
• Fix window functions in case of sparse columns. (ClickHouse#55895 by János Benjamin Antal).
• Fix segfault during Kerberos initialization (ClickHouse#56401 by Nikolay Degterinsky).
• Fix buffer overflow in T64 (ClickHouse#56434 by Alexey Milovidov).
• Fix crash in FPC codec (ClickHouse#56795 by Alexey Milovidov).
• Prevent incompatible ALTER of projection columns (ClickHouse#56948 by Amos Bird).
• Fix buffer overflow in Gorilla codec (ClickHouse#57107 by Nikolay Degterinsky).
• Close interserver connection on any exception before authentication (ClickHouse#57142 by Antonio Andelic).
• Fix segfault after ALTER UPDATE with Nullable MATERIALIZED column (ClickHouse#57147 by Nikolay Degterinsky).
• Fix incorrect JOIN plan optimization with partially materialized normal projection (ClickHouse#57196 by Amos Bird).
• MergeTree mutations reuse source part index granularity (ClickHouse#57352 by Maksim Kita).
• Fix invalid memory access in BLAKE3 (Rust) (ClickHouse#57876 by Raúl Marín).
• Normalize function names in CREATE INDEX (ClickHouse#57906 by Alexander Tokmakov).
• Fix invalid preprocessing on Keeper (ClickHouse#58069 by Antonio Andelic).
• Fix Integer overflow in Poco::UTF32Encoding (ClickHouse#58073 by Andrey Fedotov).
• Remove parallel parsing for JSONCompactEachRow (ClickHouse#58181 by Alexey Milovidov).
• Fix incorrect createColumn call on join clause (ClickHouse#48998 by Yi Sheng).

NOT FOR CHANGELOG / INSIGNIFICANT

• Test libunwind changes. (ClickHouse#51436 by Nikolai Kochetov).
• Refactor CI_CONFIG (ClickHouse#52948 by Mikhail f. Shiryaev).
• Use pathlib.Path in S3Helper, rewrite build reports, improve small things (ClickHouse#54010 by Mikhail f. Shiryaev).
• Fixed parameterized_view test after backporting a fix 23.3 (ClickHouse#54401 by SmitaRKulkarni).
• Update automated commit status comment (ClickHouse#54441 by vdimir).
• S3 artifacts (ClickHouse#54504 by Mikhail f. Shiryaev).
• Fix C...

23.8.8 Altinity Stable

Changes compared to upstream's v23.8.8.20-lts

Bug fixes

• Fixes partition pruning for extra columns in a set. (ClickHouse#55172 by @amosbird via #342)
• Fixed rare bug when we produced invalid read ranges for queries with FINAL. Resulted in Cannot read out of marks range exception. (ClickHouse#54934 by @nickitat via #343)
• Fix incorrect free space accounting for least_used JBOD policy (ClickHouse#56030 by @azat via #344)
• Fix ALTER COLUMN with ALIAS that previously threw the NO_SUCH_COLUMN_IN_TABLE exception. (ClickHouse#57395 by @evillique via #345)
• Disable system.kafka_consumers by default (due to possible live memory leak) (ClickHouse#57822 by @azat via #346)

Performance improvements

• Fixed filtering by IN(...) condition for Merge table engine. (ClickHouse#54905 by @nickitat via #341)

Build/Testing/Packaging Improvement

• Make builds possible on Altinity's infrastructure
• clickhouse-regression test suite (#338 by @MyroTk)

Packages

Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb, .rpm, or .tgz

Docker images

Available for both AMD64 and Aarch64: altinity/clickhouse-server/23.8.8.21.altinitystable

23.3.13 Altinity Stable

Changes compared to upstream's v23.3.13.6-lts

Bug fixes

• Fix key condition on duplicate primary keys (ClickHouse#48838 by @amosbird via #275 )
• Fix excessive memory usage for FINAL (ClickHouse#50429 by @azat via #307)
• Fixed DNS-related crash (ClickHouse#52634 by @arthurpassos via #295)
• Fix parquet array inconsistent offsets (ClickHouse#54370 by @arthurpassos via #303)
• Fixed rare bug when we produced invalid read ranges for queries with FINAL. Resulted in Cannot read out of marks range exception (ClickHouse#54934 by @nickitat via #313)
• Fixed reading from sparse columns after changing setting ratio_of_defaults_for_sparse_serialization back to 1.0 and restarting the server. (ClickHouse#49660 by @CurtizJ via #314)

Performance improvement

• Do not build sets for skip indexes if they are not used (ClickHouse#48299 by @CurtizJ via #276)

Improvement

• Disabled unsafe "compile_expressions" setting by default (ClickHouse#51368 by @alexey-milovidov via #306)
• Row policy for database (ClickHouse#47640 by @ilejn via #300)

Build/Testing/Packaging Improvement

• Bring back DNS tests (ClickHouse#53286 - @arthurpassos via #296)
• Made builds and tests possible in Altinity's infrastructure
• Support of Aarch64 builds (#311)
  • building Aarch64 binaries
  • multi-arch docker containers (Amd64, Aarch64)
  • running stateles, stateful tests against Aarch64
  • running clickhouse-regression tests against Aarch64

Upstream changes between v23.3.8.21-lts (1675f2264f3) and v23.3.13.6-lts (25635e27551)

Performance Improvement

• Backported in #52213: Do not store blocks in ANY hash join if nothing is inserted. #48633 (vdimir).
• Backported in #52826: Fix incorrect projection analysis which invalidates primary keys. This issue only exists when query_plan_optimize_primary_key = 1, query_plan_optimize_projection = 1 . This fixes #48823 . This fixes #51173 . #52308 (Amos Bird).

Build/Testing/Packaging Improvement

• Backported in #53019: Packing inline cache into docker images sometimes causes strange special effects. Since we don't use it at all, it's good to go. #53008 (Mikhail f. Shiryaev).
• Backported in #53288: The compiler's profile data (-ftime-trace) is uploaded to ClickHouse Cloud., the second attempt after #53100. #53213 (Alexey Milovidov).
• Backported in #53461: Preserve environment parameters in clickhouse start command. Fixes #51962. #53418 (Mikhail f. Shiryaev).
• Get rid of describe_parameters for the best robot token #53833 (Mikhail f. Shiryaev).

Bug Fix (user-visible misbehavior in an official stable release)

• Fix optimization to move functions before sorting. #51481 (Nikolai Kochetov).
• Fix Block structure mismatch in Pipe::unitePipes for FINAL #51492 (Nikita Taranov).
• Fix binary arithmetic for Nullable(IPv4) #51642 (Yakov Olkhovskiy).
• Fix async insert with deduplication for ReplicatedMergeTree using merging algorithms #51676 (Antonio Andelic).
• Support IPv4 and IPv6 as dictionary attributes #51756 (Yakov Olkhovskiy).
• Fix deadlock on DatabaseCatalog shutdown #51908 (Alexander Tokmakov).
• Fix ORDER BY tuple of WINDOW functions #52145 (Alexey Milovidov).
• Disable expression templates for time intervals #52335 (Alexander Tokmakov).
• Fix countSubstrings() hang with empty needle and a column haystack #52409 (Sergei Trifonov).
• Fixed inserting into Buffer engine #52440 (Vasily Nemkov).
• The implementation of AnyHash was non-conformant. #52448 (Alexey Milovidov).
• init and destroy ares channel on demand.. #52634 (Arthur Passos).
• Fix crash in function tuple with one sparse column argument #52659 (Anton Popov).
• clickhouse-keeper: fix implementation of server with poll() #52833 (Andy Fiddaman).
• Fix password leak in show create mysql table #52962 (Duc Canh Le).
• Not-ready Set #53162 (Nikolai Kochetov).
• Fix incorrect normal projection AST format #53347 (Amos Bird).
• Fix loading lazy database during system.table select query #53372 (SmitaRKulkarni).
• Fix wrong columns order for queries with parallel FINAL. #53489 (Nikolai Kochetov).
• Fix crash in join on sparse column #53548 (vdimir).
• Fix: interpolate expression takes source column instead of same name aliased from select expression. #53572 (Yakov Olkhovskiy).
• Correctly handle totals and extremes with DelayedSource #53644 (Antonio Andelic).
• Fix: sorted distinct with sparse columns #53711 (Igor Nikonov).
• Fix rows_before_limit_at_least for DelayedSource. #54122 (Nikolai Kochetov).
• Backport moving/ part checking code from master #54157 (Mikhail f. Shiryaev).
• Fix crash in comparison functions due to incorrect query analysis #52172 (Alexey Milovidov).
• Fix deadlocks in StorageTableFunctionProxy #52626 (Alexander Tokmakov).

NOT FOR CHANGELOG / INSIGNIFICANT

• Disable test_reverse_dns_query/test.py #53195 (Alexander Tokmakov).
• Disable test_host_regexp_multiple_ptr_records/test.py #53211 (Alexander Tokmakov).
• Fix broken 02862_sorted_distinct_sparse_fix #53738 (Antonio Andelic).

Packages

Available for both AMD64 and Aarch64 from https://builds.altinity.cloud/ as either .deb, .rpm, or .tgz

Docker images

Available for both AMD64 and Aarch64: altinity/clickhouse-server/23.3.13.7.altinitystable

22.8.20 Altinity Stable

Changes Compared to Upstream v22.8.20.11-lts

Bug fix

• Don't execute and/or/if/multiIf on LowCardinality dictionary (#44469 by @Avogar via #283)
• Do not remove inputs from maybe compiled DAG. (#48303 by @KochetovNicolai via #278)
• Arrow wouldn't abort process in case of error in input file (#45478 by @Avogar via #242)
• Fix nullptr dereference in DB::VolumeJBOD::reserve (#41483 by @amosbird via #241)
• Fix base58Encode / base58Decode handling leading 0 / '1' (#40620 by @zvonand via #224)
• Flatten list type arrow chunks on parsing (#43297 by @arthurpassos via #209)

Improvement

• Added support of chunked arrow/parquet arrays (#40485 by @arthurpassos via #223)
• Increase request_timeout_ms for s3 disks (#42321 by @filimonov via #222)
• Improved stale replica recovery process for ReplicatedMergeTree (#42134 by @tavplubix, #41945 by @alesapin via #221)

Security

• Fixed CVEs in the clickhouse-diagnostics utility

Build/Testing/Packaging Improvement

• Made builds and tests possible in Altinity's infrastructure

Changes in upstream from v22.8.15.23-lts to v22.8.20.11-lts

Bug Fix (user-visible misbehavior in an official stable release)

• Fix broken index analysis when binary operator contains a null constant argument #50177 (Amos Bird).
• Fix incorrect constant folding #50536 (Alexey Milovidov).
• Fix fuzzer failure in ActionsDAG #51301 (Alexey Milovidov).
• Fix segfault in MathUnary #51499 (Ilya Yatsishin).
• Fix subtly broken copy-on-write of ColumnLowCardinality dictionary #51064 (Michael Kolupaev).
• Generate safe IVs #51086 (Salvatore Mesoraca).
• Fix bad cast from LowCardinality column when using short circuit function execution #43311 (Kruglov Pavel).
• Fix msan issue in randomStringUTF8(uneven number) #49750 (Robert Schulze).
• JIT compilation not equals NaN fix #50056 (Maksim Kita).
• Fix crash with multiIf and constant condition and nullable arguments #50123 (Anton Popov).
• Fixed type conversion from Date/Date32 to DateTime64 when querying with DateTime64 index #50280 (Lucas Chang).
• Fix Keeper deadlock on exception when preprocessing requests. #50387 (frinkr).
• Fix Log family table return wrong rows count after truncate #50585 (flynn).
• Do not read all the columns from right GLOBAL JOIN table. #50721 (Nikolai Kochetov).
• Fix explain graph with projection #47473 (flynn).
• Disable compile_aggregate_expressions by default #48195 (Alexey Milovidov).
• Fix possible segfault in cache #48469 (Kseniia Sumarokova).
• Fix bug in Keeper when a node is not created with scheme auth in ACL sometimes. #48595 (Aleksei Filatov).
• Fix bug in zero-copy replication disk choice during fetch #47010 (alesapin).
• Fix query parameters #47488 (Alexey Milovidov).
• Fix wait for zero copy lock during move #47631 (alesapin).
• Fix crash in polygonsSymDifferenceCartesian #47702 (pufit).
• Backport to 22.8: Fix moving broken parts to the detached for the object storage disk on startup #48273 (Aleksei Filatov).

Performance Improvement

• Backported in #49214: Fixed excessive reading in queries with FINAL. #47801 (Nikita Taranov).

Improvement

• Backported in #48157: Fixed UNKNOWN_TABLE exception when attaching to a materialized view that has dependent tables that are not available. This might be useful when trying to restore state from a backup. #47975 (MikhailBurdukov).

Packages

23.3.8 Altinity Stable

Changes compared to Upstream v23.3.8.21-lts

Bug fixes

• Fix key condition on duplicate primary keys (ClickHouse#48838 by @amosbird via #275 )

Performance improvement

• Do not build sets for skip indexes if they are not used (ClickHouse#48299 by @CurtizJ via #276)

Build/Testing/Packaging Improvement

• Made builds and tests possible in Altinity's infrastructure

Full release notes

Packages

22.8.15 Altinity Stable

Changes Compared to Upstream v22.8.15.23-lts

Bug fix

• Fix base58Encode / base58Decode handling leading 0 / '1' (ClickHouse#40620 by @zvonand via #224)
• arrow wouldn't abort process in case of error in input file (ClickHouse#45478 by @Avogar via #242)
• Fix possible server crash when using the JBOD feature. (ClickHouse#41483 by @amosbird via #241)

Improvement

• Increase request_timeout_ms for s3 disks (ClickHouse#42321 by @filimonov via #222)
• Improved stale replica recovery process for ReplicatedMergeTree (ClickHouse#42134 by @tavplubix, ClickHouse#41945 by @alesapin via #221)
• Added support of chunked arrow/parquet arrays (ClickHouse#40485 by @arthurpassos via #223)

CI/CD

• executing https://github.com/Altinity/clickhouse-regression/ tests against the newly built binaries (#249 by @MyroTk)

Other

• unit-test for arrow lib errors (ClickHouse#47958 by @arthurpassos via #243)
• Do not ship clickhouse-diagnostics in clickhouse-common-static package due to golang CVEs (#257)

Changes in upstream from v22.8.13.20-lts to v22.8.15.23-lts

Performance Improvement

• Backported in #45845: Fixed performance of short SELECT queries that read from tables with large number ofArray/Map/Nested columns. #45630 (Anton Popov).
• Backported in #46374: Fix too big memory usage for vertical merges on non-remote disk. Respect max_insert_delayed_streams_for_parallel_write for the remote disk. #46275 (Nikolai Kochetov).
• Backported in #46358: Allow using Vertical merge algorithm with parts in Compact format. This will allow ClickHouse server to use much less memory for background operations. This closes #46084. #46282 (Anton Popov).

Build/Testing/Packaging Improvement

• Backported in #46112: Remove the dependency on the adduser tool from the packages, because we don't use it. This fixes #44934. #45011 (Alexey Milovidov).
• Backported in #46482: Get rid of unnecessary build for standalone clickhouse-keeper. #46367 (Mikhail f. Shiryaev).
• Backported in #46505: Some time ago the ccache compression was changed to zst, but gz archives are downloaded by default. It fixes it by prioritizing zst archive. #46490 (Mikhail f. Shiryaev).

Improvement

• Backported in #46981: - Apply ALTER TABLE table_name ON CLUSTER cluster MOVE PARTITION|PART partition_expr TO DISK|VOLUME 'disk_name' to all replicas. Because ALTER TABLE t MOVE is not replicated. #46402 (lizhuoyu5).

Bug Fix

• Backported in #45908: Fixed bug with non-parsable default value for EPHEMERAL column in table metadata. #44026 (Yakov Olkhovskiy).
• Backported in #46238: A couple of seg faults have been reported around c-ares. All of the recent stack traces observed fail on inserting into std::unodered_set<>. I believe I have found the root cause of this, it seems to be unprocessed queries. Prior to this PR, CH calls poll to wait on the file descriptors in the c-ares channel. According to the poll docs, a negative return value means an error has ocurred. Because of this, we would abort the execution and return failure. The problem is that poll will also return a negative value if a system interrupt occurs. A system interrupt does not mean the processing has failed or ended, but we would abort it anyways because we were checking for negative values. Once the execution is aborted, the whole stack is destroyed, which includes the std::unordered_set<std::string> passed to the void * parameter of the c-ares callback. Once c-ares completed the request, the callback would be invoked and would access an invalid memory address causing a segfault. #45629 (Arthur Passos).
• Backported in #45727: Fix key description when encountering duplicate primary keys. This can happen in projections. See #45590 for details. #45686 (Amos Bird).
• Backported in #46394: Fix SYSTEM UNFREEZE queries failing with the exception CANNOT_PARSE_INPUT_ASSERTION_FAILED. #46325 (Aleksei Filatov).
• Backported in #46442: Fix possible LOGICAL_ERROR in asynchronous inserts with invalid data sent in format VALUES. #46350 (Anton Popov).
• Backported in #46674: Fix an invalid processing of constant LowCardinality argument in function arrayMap. This bug could lead to a segfault in release, and logical error Bad cast in debug build. #46569 (Alexey Milovidov).
• Backported in #46879: Fix MSan report in the maxIntersections function. This closes #43126. #46847 (Alexey Milovidov).
• Backported in #46871: Fix a bug in the Map data type. This closes #46855. #46856 (Alexey Milovidov).
• Backported in #47336: Sometimes after changing a role that could be not reflected on the access rights of a user who uses that role. This PR fixes that. #46772 (Vitaly Baranov).
• Backported in #46901: - Fix incorrect alias recursion in QueryNormalizer. #46609 (Raúl Marín).
• Backported in #47156: - Fix arithmetic operations in aggregate optimization with min and max. #46705 (Duc Canh Le).
• Backported in #46987: Fix result of LIKE predicates which translate to substring searches and contain quoted non-LIKE metacharacters. #46875 (Robert Schulze).
• Backported in #47357: Fix possible deadlock on distributed query cancellation. #47161 (Kruglov Pavel).

NOT FOR CHANGELOG / INSIGNIFICANT

• Another attempt to fix automerge, or at least to have debug footprint #45476 (Mikhail f. Shiryaev).
• Add check for running workflows to merge_pr.py #45803 (Mikhail f. Shiryaev).
• Get rid of progress timestamps in release publishing #45818 (Mikhail f. Shiryaev).
• Add necessary dependency for sanitizers #45959 (Mikhail f. Shiryaev).
• Add helping logging to auto-merge script #46080 (Mikhail f. Shiryaev).
• Fix write buffer destruction order for vertical merge. #46205 (Nikolai Kochetov).
• Get rid of legacy DocsReleaseChecks #46665 (Mikhail f. Shiryaev).
• Reduce updates of Mergeable Check #46781 (Mikhail f. Shiryaev...

22.8.13 Altinity Stable

Changes Compared to Upstream v22.8.13.20-lts

Bug Fix

• Fix base58Encode / base58Decode handling leading 0 / '1' (ClickHouse#40620 by @zvonand via #224)
• fixed c-ares related crash (ClickHouse#45629 by @arthurpassos via #231)

Improvement

• Increase request_timeout_ms for s3 disks (ClickHouse#42321 by @filimonov via #222)
• Improved stale replica recovery process for ReplicatedMergeTree (ClickHouse#42134 by @tavplubix, ClickHouse#41945 by @alesapin via #221)
• Added support of chunked arrow/parquet arrays (ClickHouse#40485 by @arthurpassos via #223)

Full release notes

22.3.15.34 Altinity Stable

Based on upstream/v22.3.15.33-lts

Changes Compared to upstream v22.3.15.33-lts

Bug fixes

• Fix for exponential time decaying window functions. Now respecting boundaries of the window ClickHouse#36944 by @excitoon (via #164)
• Fixes for objects removal in S3ObjectStorage ClickHouse#37882 by @excitoon (via #164)
• Build/Testing/Packaging Improvement: Allow Github workflows to run on Altinity's infrastructure
• Fixed Unknown identifier (aggregate-function) exception ClickHouse#39762 by @quickhouse (via #189)
• Fixed point of origin for exponential decay window functions ClickHouse#39593 by @quickhouse (via #190)
• Reverted: 'Fix seeking while reading from encrypted disk' ClickHouse#39687, known to cause issues in 22.3 (via #193)
• Reverted: 'Enable using constants from with and select in aggregate function parameters.' ClickHouse#27531, causes problems on 22.3 (via #194)
• Fix memory leak while pushing to MVs w/o query context (from Kafka/...) ClickHouse#40732 by @azat (via #202)
• Fix arrow column dictionary to ch lc ClickHouse#40037 by @arthurpassos (via #209)

Improvements

• Improvement: Optimized processing of ORDER BY in window functions ClickHouse#34632 by @excitoon (via #164)
• Improvement: Support batch_delete capability for GCS ClickHouse#37659 by @frew (via #164)
• Add support for extended (chunked) arrays for Parquet format (ClickHouse#40485, ClickHouse#43297) by @arthurpassos (via #203, #211)

changes in upstream

Packages

https://builds.altinity.cloud/

22.3.12.20 Altinity Stable

Based on upstream/v22.3.12.19-lts

Changes Compared to Community Build v22.3.12.19-lts

Bug fix

• Fix for exponential time decaying window functions. Now respecting boundaries of the window ClickHouse#36944 by @excitoon (via #164)
• Fixes for objects removal in S3ObjectStorage ClickHouse#37882 by @excitoon (via #164)
• Fixed Unknown identifier (aggregate-function) exception ClickHouse#39762 by @quickhouse (via #189)
• Fixed point of origin for exponential decay window functions ClickHouse#39593 by @quickhouse (via #190)
• Fix unused unknown columns introduced by WITH statement ClickHouse#39131 by @amosbird
• Fix memory leak while pushing to MVs w/o query context (from Kafka/...) by @azat

Improvement

• Optimized processing of ORDER BY in window functions ClickHouse#34632 by @excitoon (via #164)
• Support batch_delete capability for GCS ClickHouse#37659 by @frew (via #164)
• Add support for extended (chunked) arrays for Parquet format ClickHouse#40485 by @arthurpassos

Build/Testing/Packaging Improvement

• Build/Testing/Packaging Improvement: Allow Github workflows to run on Altinity's infrastructure

Changes in upstream from v22.3.10.22-lts to v22.3.12.19-lts

Bug fix

• Fix clickhouse-server doinst.sh. ClickHouse#40681 by @Felixoid.
• fix heap buffer overflow by limiting http chunk size. ClickHouse#40292 by @CheSema.
• Fix possible segfault in CapnProto input format'. ClickHouse#40241 by @Avogar.
• Fix insufficient argument check for encryption functions'. ClickHouse#40194 by @alexey-milovidov.
• Fix HashMethodOneNumber with const column. ClickHouse#40020 by @canhld94.
• Fix seeking while reading from encrypted disk. ClickHouse#39687 by @vitlibar.
• Fix number of threads for pushing to views'. ClickHouse#39253 by @azat.

Other

• collectFilesToSkip() in MutateTask now supports new index file extension .idx2 for MinMax. ClickHouse#40122 by @robot-ch-test-poll2.
• Clean out clickhouse-server.service from /etc. ClickHouse#39323 by @Felixoid.

Full list of changes

Packages

https://builds.altinity.cloud/

22.3.10.24 Altinity Stable

Based on upstream/v22.3.10.22-lts

Changes Compared to Community Build v22.3.10.22-lts

Bug fix

• Fix for exponential time decaying window functions. Now respecting boundaries of the window ClickHouse#36944 by @excitoon (via #164)
• Fixes for objects removal in S3ObjectStorage ClickHouse#37882 by @excitoon (via #164)
• Fixed Unknown identifier (aggregate-function) exception ClickHouse#39762 by @quickhouse (via #189)
• Fixed point of origin for exponential decay window functions ClickHouse#39593 by @quickhouse (via #190)
• Reverted 'Fix seeking while reading from encrypted disk' ClickHouse#39687, known to cause issues in 22.3 (via ##193)
• Reverted: 'Enable using constants from with and select in aggregate function parameters.' ClickHouse#27531, causes problems on 22.3 (via #194)

Improvement

• Improvement: Optimized processing of ORDER BY in window functions ClickHouse#34632 by @excitoon (via #164)
• Improvement: Support batch_delete capability for GCS ClickHouse#37659 by @frew (via #164)

Build/Testing/Packaging Improvement

• Build/Testing/Packaging Improvement: Allow Github workflows to run on Altinity's infrastructure

Changes in upstream from v22.3.8.39-lts to v22.3.10.22-lts

Bug fix

• Fix CANNOT_READ_ALL_DATA with pread_threadpool.. #39800 (Anton Popov).
• Fix seeking while reading from encrypted disk. #39687 (Vitaly Baranov).
• Fix bug with maxsplit in the splitByChar. #39552 (filimonov).
• Fix data race and possible heap-buffer-overflow in Avro format. #39498 (Kruglov Pavel).
• Fix incorrect postgresql query which fetches tables list. #39283 (Kseniia Sumarokova).
• Fix segfault in materialised postgresql. #39272 (Kseniia Sumarokova).
• removed default queue arguments. #39259 (rnbondarenko).
• Fix reading of sparse columns from s3 #37978 via #39206 (robot-ch-test-poll).
• Fix reading from s3 in some corner cases #38239. via #39206 (robot-ch-test-poll).
• prewhere action should preserve sorting columns. #39157 (Yakov Olkhovskiy).
• Fix insert into MV with enabled extremes.. #39125 (Nikolai Kochetov).
• Fix for fs cache. #39070 (Kseniia Sumarokova).
• Remove logging from OvercommitTracker to avoid deadlocks. #39030 (Dmitry Novik).
• Fix reading of sparse columns from s3. #37978 (Anton Popov).
• Fix some issues with low cardinality and async reads from remote fs. #36763 (Kseniia Sumarokova).
• Fix performance regression of scalar query. #35986 (Amos Bird).

Other

• Change mysql-odbc url. #39702 (Mikhail f. Shiryaev).
• Replace MemoryTrackerBlockerInThread to LockMemoryExceptionInThread. #39619 (Nikolai Kochetov).
• Add docker_server.py running to backport and release CIs. #39011 (Mikhail f. Shiryaev).
• Retry docker buildx commands with progressive sleep in between. #38898 (Mikhail f. Shiryaev).

Full list of changes

Packages

https://builds.altinity.cloud/