Could not find module 'llama.dll' (or one of its dependencies). Try using the full path with constructor syntax.

[ScrudgMcDack]

Hello!

I encountered the following issue.
I attempted to install the extension via ComfyUI-Manager and CL.
I attempted to remove and reinstall the llama-cpp-python package in both CPU and GPU versions.

Is there any way to resolve this?

[TIPO-KGen]-|23:06:35|-WARNING: Llama-cpp-python cannot be imported

Traceback (most recent call last):
  File "C:\AU\ComfyUI\resources\ComfyUI\nodes.py", line 2216, in load_custom_node
    module_spec.loader.exec_module(module)
  File "<frozen importlib._bootstrap_external>", line 999, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "C:\AU\ComfyUI_3\custom_nodes\z-tipo-extension\__init__.py", line 1, in <module>
    from .nodes.tipo import NODE_CLASS_MAPPINGS, NODE_DISPLAY_NAME_MAPPINGS
  File "C:\AU\ComfyUI_3\custom_nodes\z-tipo-extension\nodes\tipo.py", line 15, in <module>
    import kgen.executor.tipo as tipo
  File "C:\AU\ComfyUI_3\.venv\Lib\site-packages\kgen\executor\tipo.py", line 5, in <module>
    from ..generate import generate
  File "C:\AU\ComfyUI_3\.venv\Lib\site-packages\kgen\generate.py", line 11, in <module>
    from llama_cpp import Llama
  File "C:\AU\ComfyUI_3\.venv\Lib\site-packages\llama_cpp\__init__.py", line 1, in <module>
    from .llama_cpp import *
  File "C:\AU\ComfyUI_3\.venv\Lib\site-packages\llama_cpp\llama_cpp.py", line 38, in <module>
    _lib = load_shared_library(_lib_base_name, _base_path)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\AU\ComfyUI_3\.venv\Lib\site-packages\llama_cpp\_ctypes_extensions.py", line 69, in load_shared_library
    raise RuntimeError(f"Failed to load shared library '{lib_path}': {e}")
RuntimeError: Failed to load shared library 'C:\AU\ComfyUI_3\.venv\Lib\site-packages\llama_cpp\lib\llama.dll': Could not find module 'C:\AU\ComfyUI_3\.venv\Lib\site-packages\llama_cpp\lib\llama.dll' (or one of its dependencies). Try using the full path with constructor syntax.

Cannot import C:\AU\ComfyUI_3\custom_nodes\z-tipo-extension module for custom nodes: Failed to load shared library 'C:\AU\ComfyUI_3\.venv\Lib\site-packages\llama_cpp\lib\llama.dll': Could not find module 'C:\AU\ComfyUI_3\.venv\Lib\site-packages\llama_cpp\lib\llama.dll' (or one of its dependencies). Try using the full path with constructor syntax.

[KohakuBlueleaf]

Try to install llama-cpp-python from here: https://github.com/JamePeng/llama-cpp-python/releases

or you can choose model that is not .gguf, so it will use transformers backend

[ExzzorInfluencer]

I downloaded the correct version of Llama for my version of Python and CUDA and it stopped giving this error.

[Gamalonia]

Thx for sharing. It fixes the error!

[KohakuBlueleaf]

https://github.com/abetlen/llama-cpp-python/releases
https://github.com/JamePeng/llama-cpp-python/releases