Skip to content

Commit 77f5747

Browse files
authored
Update processing.rst
1 parent 9438263 commit 77f5747

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

docs/source/processing.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -672,7 +672,7 @@ To disable caching you can run:
672672
You can also query the current status of the caching with :func:`datasets.is_caching_enabled`:
673673

674674
Mapping in a distributed setting
675-
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
675+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
676676

677677
In a distributed setting, you may use caching and a :func:`torch.distributed.barrier` to make sure that only the main process performs the mapping, while the other ones load its results. This avoids duplicating work between all the processes, or worse, requesting more CPUs than your system can handle. For example:
678678

0 commit comments

Comments
 (0)