Skip to content

Commit c825f67

Browse files
scortiermabdh
andauthored
feat: add snowflake extractor (#324)
* feat: add snowflake extractor * chore: update snowflake extractor test * chore: code cleanup * refactor: update query format * feat(snowflake): add vcr on test * feat(snowflake): add vcr fixtures * refactor: integration tags to plugins tags Co-authored-by: Muhammad Abduh <[email protected]>
1 parent ddfd7f1 commit c825f67

File tree

17 files changed

+13502
-20
lines changed

17 files changed

+13502
-20
lines changed

docs/docs/reference/extractors.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,7 @@ Meteor currently support metadata extraction on these data sources. To perform e
1919
| [`mariadb`](https://github.com/odpf/meteor/tree/main/plugins/extractors/mariadb/README.md) |||||||
2020
| [`redshift`](https://github.com/odpf/meteor/tree/main/plugins/extractors/redshift/README.md) |||||||
2121
| [`presto`](https://github.com/odpf/meteor/tree/main/plugins/extractors/presto/README.md) |||||||
22+
| [`snowflake`](https://github.com/odpf/meteor/tree/main/plugins/extractors/snowflake/README.md) |||||||
2223

2324
### Dashboard
2425

go.mod

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,6 @@ require (
3838
github.com/grpc-ecosystem/go-grpc-prometheus v1.2.0
3939
github.com/hashicorp/go-hclog v0.16.1
4040
github.com/hashicorp/go-plugin v1.4.2
41-
github.com/klauspost/compress v1.13.6 // indirect
4241
github.com/kr/text v0.2.0 // indirect
4342
github.com/lib/pq v1.10.2
4443
github.com/mcuadros/go-defaults v1.2.0
@@ -56,6 +55,7 @@ require (
5655
github.com/schollz/progressbar/v3 v3.8.5
5756
github.com/segmentio/kafka-go v0.4.17
5857
github.com/sijms/go-ora/v2 v2.2.22
58+
github.com/snowflakedb/gosnowflake v1.6.7
5959
github.com/spf13/cobra v1.2.1
6060
github.com/spf13/viper v1.8.1
6161
github.com/stretchr/testify v1.7.0

go.sum

Lines changed: 106 additions & 1 deletion
Large diffs are not rendered by default.

plugins/extractors/bigtable/bigtable_test.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
//go:build integration
2-
// +build integration
1+
//go:build plugins
2+
// +build plugins
33

44
package bigtable_test
55

plugins/extractors/cassandra/cassandra_test.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
//go:build integration
2-
// +build integration
1+
//go:build plugins
2+
// +build plugins
33

44
package cassandra_test
55

plugins/extractors/clickhouse/clickhouse_test.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
//go:build integration
2-
// +build integration
1+
//go:build plugins
2+
// +build plugins
33

44
package clickhouse_test
55

plugins/extractors/couchdb/couchdb_test.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
//go:build integration
2-
// +build integration
1+
//go:build plugins
2+
// +build plugins
33

44
package couchdb_test
55

plugins/extractors/elastic/elastic_test.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
//go:build integration
2-
// +build integration
1+
//go:build plugins
2+
// +build plugins
33

44
package elastic_test
55

plugins/extractors/kafka/kafka_test.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
//go:build integration
2-
// +build integration
1+
//go:build plugins
2+
// +build plugins
33

44
package kafka_test
55

plugins/extractors/oracle/oracle_test.go

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
//go:build integration
2-
// +build integration
1+
//go:build plugins
2+
// +build plugins
33

44
package oracle_test
55

0 commit comments

Comments
 (0)