Replies: 2 comments
-
|
You can try smaller model since Mixtral 7B need 40-ish GB of RAM. With 32GB you can try 34B models. |
Beta Was this translation helpful? Give feedback.
-
|
I've encountered the same issue. But I've also encountered this message: The model I'm using is also: My system is: I've tried reloading, forced reload, quit the app, and restarted computer, I will attempt to switch to a smaller model to see if that helps. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
When I'm trying to use Jan.
I got this error;
Error occurred: Failed to fetch
The module I'm trying to use:
Mixtral 8x7B Instruct Q4
My system:
Apple M1 Pro
32 GB RAM
Edit:
If it's an allocation problem (insufficient RAM), it would be nice to see it that way. Error message isn't very helpful at all.
Beta Was this translation helpful? Give feedback.
All reactions