Skip to content

Conversation

@albertvillanova
Copy link
Member

Fix #5118.

@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Oct 17, 2022

The documentation is not available anymore as the PR was closed or merged.

"s3fs>=2021.11.1", # aligned with fsspec[http]>=2021.11.1
"tensorflow>=2.3,!=2.6.0,!=2.6.1",
"tensorflow>=2.3,!=2.6.0,!=2.6.1; sys_platform != 'darwin' or platform_machine != 'arm64'",
"tensorflow-macos; sys_platform == 'darwin' and platform_machine == 'arm64'",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BTW I think and platform_machine == 'arm64'" is not needed, as I was able to install tensorflow-macos on my MacOS with an Intel chip

$ sysctl -a | grep Intel
machdep.cpu.vendor: GenuineIntel
machdep.cpu.brand_string: Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz

See https://github.com/huggingface/datasets-server/blob/9b346a79c5e3f51719fb2717683c4e5f86291201/services/worker/pyproject.toml#L34-L35

But maybe it's better to limit the exception cases and only use the fork for arm64.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@severo I'm not an expert on this subject. But it appears they recommend tensorflow-macos also for Intel x86-64: https://developer.apple.com/metal/tensorflow-plugin/

So you think I can safely remove and platform_machine == 'arm64'? Or better keeping to reduce the scope?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I really don't know, I just wanted to share my recent experience with the same problem, and use the same solution if you opt for a reduced scope.

@albertvillanova albertvillanova merged commit d201a39 into huggingface:main Oct 19, 2022
@albertvillanova albertvillanova deleted the fix-5118 branch October 19, 2022 09:10
severo added a commit to huggingface/dataset-viewer that referenced this pull request Oct 21, 2022
severo added a commit to huggingface/dataset-viewer that referenced this pull request Oct 21, 2022
* refactor: 💡 rename error

to ensure it's clear it's an error.Also remove an unused error

* chore: 🤖 align with the datasets library for mac install

see huggingface/datasets#5124

* feat: 🎸 update docker images
mattstern31 added a commit to mattstern31/datasets-server-storage-admin that referenced this pull request Nov 11, 2023
* refactor: 💡 rename error

to ensure it's clear it's an error.Also remove an unused error

* chore: 🤖 align with the datasets library for mac install

see huggingface/datasets#5124

* feat: 🎸 update docker images
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Installing datasets on M1 computers

3 participants