Skip to content

Conversation

@sudo-suhas
Copy link
Contributor

@sudo-suhas sudo-suhas commented Oct 5, 2022

  • Bump proton commit for code generation. Pull in the asset model for
    • MLFeatureTable
    • Service
    • Experiment
    • Metric
    • MLModel
  • Implement the machine learning feature tables extractor for CaraML store.
  • Register the extractor in plugins/extractors/populate.go.
  • Add the extractor to the list in docs/reference/extractor.md.
  • Extend config parser to support parsing
    • time duration in string format such as '30s'.
    • CSV as a string array. ex: 'comma,separated,value'.
  • Integrate github.com/vektra/mockery for mock generation.
  • Rewrite links in extractors docs to use relative paths. This works in IDEs and editors without needing to open a web page.
  • Add 't.Helper()' annotations for test helper methods. This helps with error reporting the test function line instead of helper in case of an error.
  • Add hlper method for extracting the gRPC status code from a wrapped error. The methods provided by gRPC library do not support extracting the status code from an error wrapped with additional context.
  • Add test helper method LoadJSONIntoProto.
  • Remove unused function BuildConfig from utils/config.go.

TODO:

  • Add documentation for Entity and Feature outputs.
  • Ownership for extracted assets. not required

Closes #73

@sudo-suhas sudo-suhas force-pushed the caramlstore-extractor branch 2 times, most recently from e561f8d to 91fc028 Compare October 6, 2022 02:16
@sudo-suhas sudo-suhas force-pushed the caramlstore-extractor branch from 91fc028 to 3e36929 Compare October 6, 2022 02:32
@sudo-suhas
Copy link
Contributor Author

Coverage dropped from 83% on main to 76% because utils package was not being considered earlier. By adding tests for the method that was added, coveralls is now able to see that that the utils package doesn't have good coverage.

@sudo-suhas sudo-suhas marked this pull request as ready for review October 6, 2022 09:21
@sudo-suhas sudo-suhas force-pushed the caramlstore-extractor branch from 3e36929 to 134674e Compare October 10, 2022 12:57
- Bump proton commit for code generation. Pull in the asset model for
  - MLFeatureTable
  - Service
  - Experiment
  - Metric
  - MLModel
- Implement the machine learning feature tables extractor for CaraML
  store.
  - Add the gRPC client generated from CaraML store's CoreService. See
    https://github.com/caraml-dev/caraml-store/blob/v0.1.1/caraml-store-protobuf/src/main/proto/feast/core/CoreService.proto#L12.
- Register the extractor in plugins/extractors/populate.go.
- Add the extractor to the list in docs/reference/extractor.md.
- Extend config parser to support parsing
  - time duration in string format such as '30s'.
  - CSV as a string array. ex: 'comma,separated,value'.
- Integrate github.com/vektra/mockery for mock generation.
- Rewrite links in extractors docs to use relative paths. This works
  in IDEs and editors without needing to open a web page.
- Add 't.Helper()' annotations for test helper methods. This helps with
  error reporting the test function line instead of helper in case of
  an error.
- Add hlper method for extracting the gRPC status code from a wrapped
  error. The methods provided by gRPC library do not support extracting
  the status code from an error wrapped with additional context.
- Add test helper method LoadJSONIntoProto.
- Remove unused function BuildConfig from utils/config.go.
- Refactor usage of deprecated ioutil package using os and io packages.
@sudo-suhas sudo-suhas force-pushed the caramlstore-extractor branch from 134674e to 4b73336 Compare October 11, 2022 06:30
@StewartJingga StewartJingga merged commit 54aacef into main Oct 12, 2022
@StewartJingga StewartJingga deleted the caramlstore-extractor branch October 12, 2022 04:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add metadata extractor for caraml-store

3 participants