Skip to content

Conversation

@amankhandelia
Copy link
Contributor

@amankhandelia amankhandelia commented Jul 26, 2021

Made a very minor change to fix the issue#2716. Added the missing argument in the constructor call.

As discussed in the bug report, the change is made to prevent the shuffle method call from resetting the value of batched attribute in MappedExamplesIterable

Fix #2716.

Added the missing argument in the constructor call
@amankhandelia amankhandelia changed the title Fix for huggingface/datasets#2716 Fix for #2716 Jul 26, 2021
@lhoestq lhoestq changed the title Fix for #2716 Fix shuffle on IterableDataset that disables batching in case any functions were mapped Jul 26, 2021
Copy link
Member

@lhoestq lhoestq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fix !

@lhoestq lhoestq merged commit 29098a3 into huggingface:master Jul 26, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Calling shuffle on IterableDataset will disable batching in case any functions were mapped

2 participants