load_dataset("financial_phrasebank") NonMatchingChecksumError

[courtmckay]

Describe the bug

Attempting to download the financial_phrasebank dataset results in a NonMatchingChecksumError

Steps to reproduce the bug

from datasets import load_dataset
dataset = load_dataset("financial_phrasebank", 'sentences_allagree')

Expected results

I expect to see the financial_phrasebank dataset downloaded successfully

Actual results

NonMatchingChecksumError: Checksums didn't match for dataset source files:
['https://www.researchgate.net/profile/Pekka_Malo/publication/251231364_FinancialPhraseBank-v10/data/0c96051eee4fb1d56e000000/FinancialPhraseBank-v10.zip']

Environment info

• datasets version: 1.9.0
• Platform: Linux-4.14.232-177.418.amzn2.x86_64-x86_64-with-debian-10.6
• Python version: 3.7.10
• PyArrow version: 4.0.1

[Ap1075]

Hi! It's probably because this dataset is stored on google drive and it has a per day quota limit. It should work if you retry, I was able to initiate the download.

Similar issue here

[lhoestq]

Hi ! Loading the dataset works on my side as well.
Feel free to try again and let us know if it works for you know

[courtmckay]

Thank you! I've been trying periodically for the past month, and no luck yet with this particular dataset. Just tried again and still hitting the checksum error.

Code:

dataset = load_dataset("financial_phrasebank", "sentences_allagree")

Traceback:

---------------------------------------------------------------------------
NonMatchingChecksumError                  Traceback (most recent call last)
<ipython-input-2-55cc2144f31e> in <module>
----> 1 dataset = load_dataset("financial_phrasebank", "sentences_allagree")

/opt/conda/lib/python3.7/site-packages/datasets/load.py in load_dataset(path, name, data_dir, data_files, split, cache_dir, features, download_config, download_mode, ignore_verifications, keep_in_memory, save_infos, script_version, use_auth_token, task, streaming, **config_kwargs)
    859         ignore_verifications=ignore_verifications,
    860         try_from_hf_gcs=try_from_hf_gcs,
--> 861         use_auth_token=use_auth_token,
    862     )
    863 

/opt/conda/lib/python3.7/site-packages/datasets/builder.py in download_and_prepare(self, download_config, download_mode, ignore_verifications, try_from_hf_gcs, dl_manager, base_path, use_auth_token, **download_and_prepare_kwargs)
    582                     if not downloaded_from_gcs:
    583                         self._download_and_prepare(
--> 584                             dl_manager=dl_manager, verify_infos=verify_infos, **download_and_prepare_kwargs
    585                         )
    586                     # Sync info

/opt/conda/lib/python3.7/site-packages/datasets/builder.py in _download_and_prepare(self, dl_manager, verify_infos, **prepare_split_kwargs)
    642         if verify_infos:
    643             verify_checksums(
--> 644                 self.info.download_checksums, dl_manager.get_recorded_sizes_checksums(), "dataset source files"
    645             )
    646 

/opt/conda/lib/python3.7/site-packages/datasets/utils/info_utils.py in verify_checksums(expected_checksums, recorded_checksums, verification_name)
     38     if len(bad_urls) > 0:
     39         error_msg = "Checksums didn't match" + for_verification_name + ":\n"
---> 40         raise NonMatchingChecksumError(error_msg + str(bad_urls))
     41     logger.info("All the checksums matched successfully" + for_verification_name)
     42 

NonMatchingChecksumError: Checksums didn't match for dataset source files:
['https://www.researchgate.net/profile/Pekka_Malo/publication/251231364_FinancialPhraseBank-v10/data/0c96051eee4fb1d56e000000/FinancialPhraseBank-v10.zip']

[albertvillanova]

Fixed once data files are hosted on the Hub:

• Host financial_phrasebank data on the Hub #4598