Skip to content

Fix directory creating for saving with multiprocessing#185

Merged
tridao merged 1 commit intostate-spaces:mainfrom
deroholic:save-fix
Mar 11, 2024
Merged

Fix directory creating for saving with multiprocessing#185
tridao merged 1 commit intostate-spaces:mainfrom
deroholic:save-fix

Conversation

@deroholic
Copy link
Copy Markdown
Contributor

The save_pretrained() method can and often will fail when training with multi-processes because the save directory can be created by another process after the check of its existence which will result in an exception from os.makedirs().

@tridao tridao merged commit 9127d1f into state-spaces:main Mar 11, 2024
@tridao
Copy link
Copy Markdown
Collaborator

tridao commented Mar 11, 2024

Thanks!

Esthercyz pushed a commit to Esthercyz/mamba_1 that referenced this pull request Jan 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants