Make loading weights 10-100x faster #613

Merged

jart merged 9 commits intoggml-org:masterfrom

Mar 30, 2023

Commits on Mar 29, 2023

Add mmap support for model files

slaren
authored and
jart
committed
Fix ggml_init_params in quantize

slaren
authored and
jart
committed
Make mmap_file static

slaren
authored and
jart
committed
Unmap the file in llama_free

slaren
authored and
jart
committed
Always initialize mm_addr and mm_length in llama_model

slaren
authored and
jart
committed
Initial windows support (untested)

slaren
authored and
jart
committed

Commits on Mar 30, 2023