Skip to content

Commit 7566e48

Browse files
committed
feat: add application_yaml extractor
- Add application_yaml extractor for reading the given YAML file and emitting an Asset of type service. - Fix relative link to contributing guide in plugin READMEs. - Remove unused code in utils/config.go - Move and use private helper functions in caramlstore extractor to plugin pkg for - parsing Kafka scope from bootstrap servers - constructing URN from BigQuery table's fully qualified name.
1 parent 1c7f96e commit 7566e48

61 files changed

Lines changed: 1274 additions & 373 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

Makefile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
NAME="github.com/odpf/meteor"
22
VERSION=$(shell git describe --always --tags 2>/dev/null)
33
COVERFILE="/tmp/app.coverprofile"
4-
PROTON_COMMIT := "0acbe8af97af5565155f332b1c837ce5e9fb6956"
4+
PROTON_COMMIT := "5350bdec0f294005de2562dbcac0fef7e11f6bef"
55
.PHONY: all build clean test
66

77
all: build

docs/docs/reference/extractors.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -64,6 +64,11 @@ Meteor currently supports metadata extraction on these data sources. To perform
6464
|:------------------------------------|:----------|:----------|:------------|:-------|
6565
| [`caramlstore`][caramlstore-readme] |||||
6666

67+
### Service
68+
69+
| Type | Ownership | Upstreams | Downstreams | Custom |
70+
|:-------------------------------|:----------|:----------|:------------|:-------|
71+
| [`service_yaml`][service-yaml] ||||||
6772

6873
<!--- Not using relative links because that breaks the docs build -->
6974

@@ -91,3 +96,4 @@ Meteor currently supports metadata extraction on these data sources. To perform
9196
[gcs-readme]: https://github.com/odpf/meteor/tree/main/plugins/extractors/gcs/README.md
9297
[optimus-readme]: https://github.com/odpf/meteor/tree/main/plugins/extractors/optimus/README.md
9398
[caramlstore-readme]: https://github.com/odpf/meteor/tree/main/plugins/extractors/caramlstore/README.md
99+
[service-yaml]: https://github.com/odpf/meteor/tree/main/plugins/extractors/service_yaml/README.md

models/odpf/assets/v1beta2/application.pb.go

Lines changed: 192 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)