Skip to content

Conversation

@mend-for-github.zerozr99.workers.dev
Copy link

@mend-for-github.zerozr99.workers.dev mend-for-github.zerozr99.workers.dev bot commented Oct 31, 2024

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
black (changelog) ==24.4.2 -> ==24.10.0 age adoption passing confidence
datasets >=2.14.6,<2.17 -> >=2.21,<2.22 age adoption passing confidence

Release Notes

psf/black (black)

v24.10.0

Compare Source

Highlights
  • Black is now officially tested with Python 3.13 and provides Python 3.13
    mypyc-compiled wheels. (#​4436) (#​4449)
  • Black will issue an error when used with Python 3.12.5, due to an upstream memory
    safety issue in Python 3.12.5 that can cause Black's AST safety checks to fail. Please
    use Python 3.12.6 or Python 3.12.4 instead. (#​4447)
  • Black no longer supports running with Python 3.8 (#​4452)
Stable style
  • Fix crashes involving comments in parenthesised return types or X | Y style unions.
    (#​4453)
  • Fix skipping Jupyter cells with unknown %% magic (#​4462)
Preview style
  • Fix type annotation spacing between * and more complex type variable tuple (i.e. def fn(*args: *tuple[*Ts, T]) -> None: pass) (#​4440)
Caching
  • Fix bug where the cache was shared between runs with and without --unstable (#​4466)
Packaging
  • Upgrade version of mypyc used to 1.12 beta (#​4450) (#​4449)
  • blackd now requires a newer version of aiohttp. (#​4451)
Output
  • Added Python target version information on parse error (#​4378)
  • Add information about Black version to internal error messages (#​4457)

v24.8.0

Compare Source

Stable style
  • Fix crash when # fmt: off is used before a closing parenthesis or bracket. (#​4363)
Packaging
  • Packaging metadata updated: docs are explictly linked, the issue tracker is now also
    linked. This improves the PyPI listing for Black. (#​4345)
Parser
  • Fix regression where Black failed to parse a multiline f-string containing another
    multiline string (#​4339)
  • Fix regression where Black failed to parse an escaped single quote inside an f-string
    (#​4401)
  • Fix bug with Black incorrectly parsing empty lines with a backslash (#​4343)
  • Fix bugs with Black's tokenizer not handling \{ inside f-strings very well (#​4422)
  • Fix incorrect line numbers in the tokenizer for certain tokens within f-strings
    (#​4423)
Performance
  • Improve performance when a large directory is listed in .gitignore (#​4415)
Blackd
  • Fix blackd (and all extras installs) for docker container (#​4357)
huggingface/datasets (datasets)

v2.21.0

Compare Source

Features
  • Support pyarrow large_list by @​albertvillanova in #​7019
    • Support Polars round trip:
      import polars as pl
      from datasets import Dataset
      
      df1 = pl.from_dict({"col_1": [[1, 2], [3, 4]]}
      df2 = Dataset.from_polars(df).to_polars()
      assert df1.equals(df2)
What's Changed
New Contributors

Full Changelog: huggingface/datasets@2.20.0...2.21.0

v2.20.0

Compare Source

Important
  • Remove default trust_remote_code=True by @​lhoestq in #​6954
    • datasets with a python loading script now require passing trust_remote_code=True to be used
Datasets features
  • [Resumable IterableDataset] Add IterableDataset state_dict by @​lhoestq in #​6658
    • checkpoint and resume an iterable dataset (e.g. when streaming):

      >>> iterable_dataset = Dataset.from_dict({"a": range(6)}).to_iterable_dataset(num_shards=3)
      >>> for idx, example in enumerate(iterable_dataset):
      ...     print(example)
      ...     if idx == 2:
      ...         state_dict = iterable_dataset.state_dict()
      ...         print("checkpoint")
      ...         break
      >>> iterable_dataset.load_state_dict(state_dict)
      >>> print(f"restart from checkpoint")
      >>> for example in iterable_dataset:
      ...     print(example)

      Returns:

      {'a': 0}
      {'a': 1}
      {'a': 2}
      checkpoint
      restart from checkpoint
      {'a': 3}
      {'a': 4}
      {'a': 5}
      
General improvements and bug fixes
New Contributors

Full Changelog: huggingface/datasets@2.19.0...2.20.0

v2.19.2

Compare Source

Bug fixes

Full Changelog: huggingface/datasets@2.19.1...2.19.2

v2.19.1

Compare Source

Bug fixes

Full Changelog: huggingface/datasets@2.19.0...2.19.1

v2.19.0

Compare Source

Dataset Features
  • Add Polars compatibility by @​psmyth94 in #​6531
    • convert to a Polars dataframe using .to_polars();
      import polars as pl
      from datasets import load_dataset
      ds = load_dataset("DIBT/10k_prompts_ranked", split="train")
      ds.to_polars() \
          .groupby("topic") \
          .agg(pl.len(), pl.first()) \
          .sort("len", descending=True)
    • Use Polars formatting to return Polars objects when accessing a dataset:
      ds = ds.with_format("polars")
      ds[:10].group_by("kind").len()
  • Add fsspec support for to_json, to_csv, and to_parquet by @​alvarobartt in #​6096
    • Save on HF in any file format:
      ds.to_json("hf://datasets/username/my_json_dataset/data.jsonl")
      ds.to_csv("hf://datasets/username/my_csv_dataset/data.csv")
      ds.to_parquet("hf://datasets/username/my_parquet_dataset/data.parquet")
  • Add mode parameter to Image feature by @​mariosasko in #​6735
    • Set images to be read in a certain mode like "RGB"
      dataset = dataset.cast_column("image", Image(mode="RGB"))
  • Add CLI function to convert script-dataset to Parquet by @​albertvillanova in #​6795
    • run command to open a PR in script-based dataset to convert it to Parquet:
      datasets-cli convert_to_parquet <dataset_id>
      
  • Add Dataset.take and Dataset.skip by @​lhoestq in #​6813
    • same as IterableDataset.take and IterableDataset.skip
      ds = ds.take(10)  # take only the first 10 examples
General improvements and bug fixes
New Contributors

Full Changelog: huggingface/datasets@2.18.0...2.19.0

v2.18.0

Compare Source

Dataset features
General improvements and bug fixes
New Contributors

Full Changelog: huggingface/datasets@2.17.1...2.18.0

v2.17.1

Compare Source

Bug Fixes

Full Changelog: huggingface/datasets@2.17.0...2.17.1

v2.17.0

Compare Source

Dataset Features
General improvements and bug fixes
New Contributors

Full Changelog: huggingface/datasets@2.16.1...2.17.0


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.


  • If you want to rebase/retry this PR, check this box

@mend-for-github.zerozr99.workers.dev mend-for-github.zerozr99.workers.dev bot changed the title chore(deps): update mend: high confidence minor and patch dependency updates fix(deps): update mend: high confidence minor and patch dependency updates Jan 7, 2025
@mend-for-github.zerozr99.workers.dev mend-for-github.zerozr99.workers.dev bot force-pushed the whitesource-remediate/mend-high-confidence-minor-and-patch-dependency-updates branch from 81c599c to a1cee8c Compare March 13, 2025 22:42
@mend-for-github.zerozr99.workers.dev mend-for-github.zerozr99.workers.dev bot changed the title fix(deps): update mend: high confidence minor and patch dependency updates chore(deps): update mend: high confidence minor and patch dependency updates Sep 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant