-
Notifications
You must be signed in to change notification settings - Fork 1.4k
fix: Add Parquet reserved keywords #12625
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
✅ Deploy Preview for meta-velox canceled.
|
|
@wraymo Thanks for the fix. Can you add a test? |
|
@majetideepak Just added a test. Could you take a look? |
majetideepak
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@wraymo Thanks!
|
@xiaoxmeng has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
|
@xiaoxmeng merged this pull request in 68a7033. |
|
Conbench analyzed the 1 benchmark run on commit There were no benchmark performance regressions. 🎉 The full Conbench report has more details. |
Summary: Summary This PR adds Parquet reserved keywords to handle Parquet files generated by the Presto Java workers. Fixes: facebookincubator#12620. References https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/HiveSchemaConverter.java#L154 https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.java#L78 Pull Request resolved: facebookincubator#12625 Reviewed By: pedroerp Differential Revision: D71557476 Pulled By: xiaoxmeng fbshipit-source-id: babeffad086049e9c52cfb16c93a8c2aed1cf029
Summary
This PR adds Parquet reserved keywords to handle Parquet files generated by the Presto Java workers.
Fixes: #12620.
References
https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/HiveSchemaConverter.java#L154
https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.java#L78