Skip to content

Conversation

@mariosasko
Copy link
Collaborator

@mariosasko mariosasko commented Jul 16, 2021

The goal of this PR is to remove duplicated checks in the map logic to execute them only once whenever possible (fn_kwargs, input_columns, ...). Additionally, this PR improves the consistency (to align it with input_columns) of the remove_columns check by adding support for a single string value, which is then wrapped into a list.

@mariosasko
Copy link
Collaborator Author

@lhoestq This one has been open for a while. Could you please take a look?

Copy link
Member

@lhoestq lhoestq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi ! Sorry for the late review

Indeed it makes more sense to have those checks in map directly.

I just added one comment

@mariosasko mariosasko requested a review from lhoestq September 3, 2021 11:05
@mariosasko
Copy link
Collaborator Author

@lhoestq Ready for the final review!

@mariosasko
Copy link
Collaborator Author

mariosasko commented Sep 5, 2021

I forgot to update the signature of DatasetDict.map, so did that now.

Copy link
Member

@lhoestq lhoestq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot ! LGTM :)

@lhoestq lhoestq merged commit 9257c6e into huggingface:master Sep 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants