Skip to content

FilesIterable skips all the files after a hidden file #6090

@dkrivosic

Description

@dkrivosic

Describe the bug

When initializing FilesIterable with a list of file paths using FilesIterable.from_paths, it will discard all the files after a hidden file.
The problem is in this line where return should be replaced by continue.

Steps to reproduce the bug

https://colab.research.google.com/drive/1SQlxs4y_LSo1Q89KnFoYDSyyKEISun_J#scrollTo=93K4_blkW-8-

Expected behavior

The script should print all the files except the hidden one.

Environment info

  • datasets version: 2.14.1
  • Platform: Linux-5.15.109+-x86_64-with-glibc2.35
  • Python version: 3.10.6
  • Huggingface_hub version: 0.16.4
  • PyArrow version: 9.0.0
  • Pandas version: 1.5.3

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions