Thanks to visit codestin.com
Credit goes to github.com

Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: huggingface/datasets
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: 4.2.0
Choose a base ref
...
head repository: huggingface/datasets
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: 4.3.0
Choose a head ref
  • 12 commits
  • 17 files changed
  • 6 contributors

Commits on Oct 9, 2025

  1. Set dev version (#7809) 

    set dev version
    @lhoestq
    lhoestq authored Oct 9, 2025
    Configuration menu
    Copy the full SHA
    f25661f View commit details
    Browse the repository at this point in the history

  2. fix conda deps (#7810)

    @lhoestq
    lhoestq authored Oct 9, 2025
    Configuration menu
    Copy the full SHA
    88d53e2 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2025

  1. Add pyarrow's binary view to features (#7795) 

    This commit will be squashed.
    @delta003
    delta003 authored Oct 10, 2025
    Configuration menu
    Copy the full SHA
    63c933a View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2025

  1. Fix polars cast column image (#7800) 

    * fix polars cast_column issue

* remove debug statements

* cast large_strings to string for image handling
    @CloseChoice
    CloseChoice authored Oct 13, 2025
    Configuration menu
    Copy the full SHA
    aa7f2a9 View commit details
    Browse the repository at this point in the history

  2. Allow streaming hdf5 files (#7814) 

    allow streaming hdf5 files
    @lhoestq
    lhoestq authored Oct 13, 2025
    Configuration menu
    Copy the full SHA
    3e13d30 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2025

  1. Retry open hf file (#7822) 

    retry open hf file
    @lhoestq
    lhoestq authored Oct 17, 2025
    Configuration menu
    Copy the full SHA
    12f5aca View commit details
    Browse the repository at this point in the history

  2. Keep hffs cache in workers when streaming (#7820) 

    * keep hffs cache in workers when streaming

* bonus: reorder hffs args to improve caching
    @lhoestq
    lhoestq authored Oct 17, 2025
    Configuration menu
    Copy the full SHA
    0b2a4c2 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2025

  1. Fix batch_size default description in to_polars docstrings (#7824)

    @albertvillanova
    albertvillanova authored Oct 20, 2025
    Configuration menu
    Copy the full SHA
    74c7154 View commit details
    Browse the repository at this point in the history

  2. docs: document_dataset PDFs & OCR (#7812) 

    * Update document_dataset.mdx

* Update document_dataset.mdx OCR
    @ethanknights
    ethanknights authored Oct 20, 2025
    Configuration menu
    Copy the full SHA
    fb445ff View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2025

  1. Add custom fingerprint support to from_generator (#7533) 

    * Add custom suffix support to from_generator

* Renamed a new arg to fingerprint

* Changed name to config_id in builder

* Change version

* Added a test

* Version update

* Update version

* Update tests/test_arrow_dataset.py

* Rename config_id to fingerprint in generator.py

* Apply suggestions from code review

* Update src/datasets/io/generator.py

* Apply suggestions from code review

---------

Co-authored-by: Quentin Lhoest <[email protected]>
    @simonreise @lhoestq
    simonreise and lhoestq authored Oct 23, 2025
    Configuration menu
    Copy the full SHA
    d10e846 View commit details
    Browse the repository at this point in the history

  2. picklable batch_fn (#7826)

    @lhoestq
    lhoestq authored Oct 23, 2025
    Configuration menu
    Copy the full SHA
    9332649 View commit details
    Browse the repository at this point in the history

  3. release: 4.3.0 (#7827)

    @lhoestq
    lhoestq authored Oct 23, 2025
    Configuration menu
    Copy the full SHA
    41c0529 View commit details
    Browse the repository at this point in the history
Loading