Skip to content

Update cdp-ucsc-dbt-codegen with changes from upstream origin repo dbt-codegen#9

Merged
insuhpak merged 28 commits intocdp-ucsc:mainfrom
dbt-labs:main
Apr 23, 2025
Merged

Update cdp-ucsc-dbt-codegen with changes from upstream origin repo dbt-codegen#9
insuhpak merged 28 commits intocdp-ucsc:mainfrom
dbt-labs:main

Conversation

@insuhpak
Copy link

No description provided.

gwenwindflower and others added 28 commits June 4, 2024 11:55
* Update changelog

* Fix typo in CHANGELOG

* Attempt to fix integration test case sensitivity for redshift

* Always lower on Redshift

* Fix indentation

* Fix whitespace

* Fix whitespace pt 2

* Update case sensitive seeds into folder

* Use + for quote_columns config

* Lower schema on redshift

* Use target.type

* Do some nonsense to make this work for Redshift

* Move seeds config to properties.yml

* Bypass redshift completely

* Temporarily bypass Redshift in CI completely

* Turn Redshift CI back on

* Delete case sensitivity test

* Delete case sensitive seed

* Delete properties.yml for case sensitive seeds
* add tox

* add postgres/redshift/bq

* add more wh, update var names

* fix profiles key

* move supported adapters

* Add CI workflow

* update to allow circleci to keep working

* fix BQ var name

* remove config from profile

* move to just support postgres

* fix vars

* use premade workflow

* add newline

* use merged version

* add comments about future adapters

* use tag

* update readme

* Add lines

* reowkr profile so it can be reused

* add sample env files and fix comment

* Update .circleci/config.yml

Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com>

* let circleCI set the schema

* fix readme instructions

* undo non-postgres changes

---------

Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com>
#192)

* Restore case sensitivity test

* Try to make integration test adapter-agnostic

* Try to make integration test CI-agnostic and adapter-agnostic

* Use adapter-agnostic data types

* Temporarily hard-code case-insensitive seed name for Snowflake

* Temporarily hard-code case-insensitive seed name for Snowflake
* add snowflake

* fix profiles

* check what’s installed

* pass in snowflake password

* and more env to gitignore
#199)

* Use `adapter.quote` to create a case-sensitive quoted identifier for column names

* Force a failure for all adapters to help troubleshoot

* Revert "Force a failure for all adapters to help troubleshoot"

This reverts commit d707832.

* Use `adapter.quote` to create a case-sensitive quoted identifier for column names in `generate_base_model` macro
#214)

* Use the `cimg/postgres` Docker image created by CircleCI with continuous integration builds in mind

* Add the root Postgres user to the environment
* Independent workflow job for dbt-postgres

* Remove activation of virtual environment

* Try without `python -m`

* Independent workflow job for dbt-redshift

* Independent workflow job for dbt-snowflake

* Independent workflow job for dbt-snowflake

* Independent workflow job for dbt-bigquery

* Independent workflow job for dbt-bigquery

* Independent workflow job for dbt-bigquery

* Independent workflow job for dbt-bigquery

* Independent workflow job for dbt-bigquery

* Setup environment variables for dbt-bigquery
* Simplify environment variables for BigQuery in CircleCI

* Fix YAML parsing error

* Fix reference to environment variable

* Fix reference to environment variable
* Disable two CI tests

* Use a dynamic schema name based off the target schema rather than a hardcoded one

* Restore one of the CI tests

* Try updating the expected output

* Update expected model given upstream changes

* Restore the other CI test

* Update expected model given upstream changes
Co-authored-by: Doug Beatty <doug.beatty@dbtlabs.com>
* add support for bigquery testing

* add missing var in tox file

* Temporarily only run CI tests for BigQuery

* Prefix the schema for the data source in CI with the name of the target schema

* Store artifacts for logs and target directories for BigQuery

* Set up environment variable for BigQuery credentials (keyfile for service account JSON)

* Set the custom schema in the source definition

* Use the target schema

* Try to align actual vs. expected when the schema name is variable

* Remove extraneous storage of artifacts

* Temporarily disable two failing CI tests

* Revert "Temporarily disable two failing CI tests"

This reverts commit d70d776.

---------

Co-authored-by: Doug Beatty <doug.beatty@dbtlabs.com>
* Upgrade from Postgres 9 to 17

* The postgres image in CircleCI needs a major and minor version specified
* Handle BigQuery repeated fields data_types

* include nested repated structs

* override repeated struct data_type with array

* Add trailing newline

* update changelog

* Update CHANGELOG.md

---------

Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com>
* Align the PR description with dbt-core, dbt-adapters, etc.

* Add hyperlink to the open issues
* Update CODEOWNERS file with global codeowner

* Update .github/CODEOWNERS

---------

Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com>
* adding generate_unit_test_template_macro

* added a relation exists check

* adding arg to controle inline/multiline columns

* Removing duplicated `get_resource_from_unique_id` macro

* Add newline to end of file

* Add a simple incremental model for testing

* CI tests

* Use dispatch, etc.

* Usage documentation for `generate_unit_test_template` macro

---------

Co-authored-by: Bruno Souza de Lima <bruno@Brunos-MacBook-M3-Pro.local>
Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com>
@insuhpak insuhpak merged commit 78f4dca into cdp-ucsc:main Apr 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants