Safely load datasets by disabling execution of dataset loading script

[irenedea]

Feature request

Is there a way to disable execution of dataset loading script using load_dataset? This is a security vulnerability that could lead to arbitrary code execution.

Any suggested workarounds are welcome as well.

Motivation

This is a security vulnerability that could lead to arbitrary code execution.

Your contribution

n/a

[julien-c]

great idea IMO

this could be a trust_remote_code=True flag like in transformers. We could also default to loading the Parquet conversion rather than executing code (for dataset repos that have both)

[dakinggg]

@julien-c that would be great!

[lhoestq]

We added the trust_remote_code argument to load_dataset() in datasets 2.16:

• in the future users will have to pass trust_remote_code=True to use datasets with a script
• for now we just show a warning when a dataset script is used
• we fallback on the Hugging Face Parquet exports when possible (to keep compatibility with old datasets with scripts)

So feel free to use trust_remote_code=False in the meantime to disable loading from dataset loading scripts :)

[lhoestq]

Passing trust_remote_code=True explicitly is now mandatory to load a dataset with a script since #6954