Skip to content

Conversation

@mroeschke
Copy link
Member

No description provided.

@mroeschke mroeschke added Testing pandas testing functions or related to the test suite IO CSV read_csv, to_csv Arrow pyarrow functionality labels Nov 6, 2023
result = parser.read_csv(fname, index_col=0, parse_dates=True)

# TODO: make unit check more specific
if parser.engine == "pyarrow":
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't we have a pyarrow version compat instead of blanket doing this? I think we should just take whatever precision pyarrow provides?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should just take whatever precision pyarrow provides?

Yeah agreed. We have the same TODO comment on the main branch where ideally we should do a version compat check (IMO it's worth investing the change there as this is just to get the 2.1.x branch green again)

@mroeschke mroeschke added this to the 2.1.3 milestone Nov 7, 2023
@mroeschke
Copy link
Member Author

Since this PR is green going to merge to allow other backport PRs to signal green if possible

@mroeschke mroeschke merged commit c9854d9 into pandas-dev:2.1.x Nov 7, 2023
@mroeschke mroeschke deleted the tst/pyarrow_failures branch November 7, 2023 20:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Arrow pyarrow functionality IO CSV read_csv, to_csv Testing pandas testing functions or related to the test suite

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants