Ollama and gguf

https://news.ycombinator.com/rss Hits: 11
Summary

What is the issue? The original model coudl run without problem, but the gguf model fail to run for below errors May need an update of ggml dependencies like llama.cpp ggml-org/llama.cpp#15091 Note: Running gguf on llama.cpp without problem. Relevant log output Aug 06 03:40:33 ml-machine-1 ollama[2649079]: gguf_init_from_file_impl: tensor ' blk.0.ffn_down_exps.weight ' has invalid ggml type 39 (NONE) Aug 06 03:40:33 ml-machine-1 ollama[2649079]: gguf_init_from_file_impl: failed to read tensor info OS No response GPU No response CPU No response Ollama version No response

First seen: 2025-08-11 20:51

Last seen: 2025-08-12 06:52