Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions docs/docs/reference/extractors.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ Meteor currently support metadata extraction on these data sources. To perform e
| [`mariadb`](https://github.com/odpf/meteor/tree/main/plugins/extractors/mariadb/README.md) | ✅ | ✅ | ✅ | ✗ | ✗ | ✗ |
| [`redshift`](https://github.com/odpf/meteor/tree/main/plugins/extractors/redshift/README.md) | ✅ | ✅ | ✅ | ✗ | ✗ | ✗ |
| [`presto`](https://github.com/odpf/meteor/tree/main/plugins/extractors/presto/README.md) | ✅ | ✅ | ✅ | ✗ | ✗ | ✗ |
| [`snowflake`](https://github.com/odpf/meteor/tree/main/plugins/extractors/snowflake/README.md) | ✅ | ✅ | ✅ | ✗ | ✗ | ✗ |

### Dashboard

Expand Down
2 changes: 1 addition & 1 deletion go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,6 @@ require (
github.com/grpc-ecosystem/go-grpc-prometheus v1.2.0
github.com/hashicorp/go-hclog v0.16.1
github.com/hashicorp/go-plugin v1.4.2
github.com/klauspost/compress v1.13.6 // indirect
github.com/kr/text v0.2.0 // indirect
github.com/lib/pq v1.10.2
github.com/mcuadros/go-defaults v1.2.0
Expand All @@ -56,6 +55,7 @@ require (
github.com/schollz/progressbar/v3 v3.8.5
github.com/segmentio/kafka-go v0.4.17
github.com/sijms/go-ora/v2 v2.2.22
github.com/snowflakedb/gosnowflake v1.6.7
github.com/spf13/cobra v1.2.1
github.com/spf13/viper v1.8.1
github.com/stretchr/testify v1.7.0
Expand Down
107 changes: 106 additions & 1 deletion go.sum

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions plugins/extractors/bigtable/bigtable_test.go
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
//go:build integration
// +build integration
//go:build plugins
// +build plugins

package bigtable_test

Expand Down
4 changes: 2 additions & 2 deletions plugins/extractors/cassandra/cassandra_test.go
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
//go:build integration
// +build integration
//go:build plugins
// +build plugins

package cassandra_test

Expand Down
4 changes: 2 additions & 2 deletions plugins/extractors/clickhouse/clickhouse_test.go
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
//go:build integration
// +build integration
//go:build plugins
// +build plugins

package clickhouse_test

Expand Down
4 changes: 2 additions & 2 deletions plugins/extractors/couchdb/couchdb_test.go
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
//go:build integration
// +build integration
//go:build plugins
// +build plugins

package couchdb_test

Expand Down
4 changes: 2 additions & 2 deletions plugins/extractors/elastic/elastic_test.go
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
//go:build integration
// +build integration
//go:build plugins
// +build plugins

package elastic_test

Expand Down
4 changes: 2 additions & 2 deletions plugins/extractors/kafka/kafka_test.go
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
//go:build integration
// +build integration
//go:build plugins
// +build plugins

package kafka_test

Expand Down
4 changes: 2 additions & 2 deletions plugins/extractors/oracle/oracle_test.go
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
//go:build integration
// +build integration
//go:build plugins
// +build plugins

package oracle_test

Expand Down
1 change: 1 addition & 0 deletions plugins/extractors/populate.go
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ import (
_ "github.com/odpf/meteor/plugins/extractors/postgres"
_ "github.com/odpf/meteor/plugins/extractors/redshift"
_ "github.com/odpf/meteor/plugins/extractors/presto"
_ "github.com/odpf/meteor/plugins/extractors/snowflake"
_ "github.com/odpf/meteor/plugins/extractors/superset"
_ "github.com/odpf/meteor/plugins/extractors/tableau"
)
40 changes: 40 additions & 0 deletions plugins/extractors/snowflake/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
# snowflake

## Usage

```yaml
source:
type: snowflake
config:
connection_url: user:password@my_organization-my_account/mydb
```

## Inputs

| Key | Value | Example | Description | |
| :-- | :---- | :------ | :---------- | :- |
| `connection_url` | `string` | `user:password@org22-acc123/mydb` | URL to access the snowflake server | *required* |

## Outputs

| Field | Sample Value |
|:-------------------|:-----------------------|
| `resource.urn` | `my_database.my_table` |
| `resource.name` | `my_table` |
| `resource.service` | `snowflake` |
| `description` | `table description` |
| `schema` | [][Column](#column) |

### Column

| Field | Sample Value |
|:--------------|:---------------------|
| `name` | `total_price` |
| `description` | `item's total price` |
| `data_type` | `decimal` |
| `is_nullable` | `true` |
| `length` | `11` |

## Contributing

Refer to the [contribution guidelines](../../../docs/contribute/guide.md#adding-a-new-extractor) for information on contributing to this module.
Loading