Ollama
Notes
New models
- OpenHermes 2 Mistral: a new fine-tuned model based on Mistral, trained on open datasets totalling over 900,000 instructions. This model has strong multi-turn chat skills, surpassing previous Hermes 13B models and even matching 70B models on some benchmarks.
What's Changed
- Faster model switching: models will now stay loaded between requests when using different parameters (e.g.
temperature) or system prompts starcoder,sqlcoderandfalconmodels now have unicode support. Note: they will need to be re-pulled (e.g.ollama pull starcoder)- New documentation guide on importing existing models to Ollama (GGUF, PyTorch, etc)
ollama servewill now print the current version of Ollama on startollama runwill now show more descriptive errors when encountering runtime issues (such as insufficient memory)- Fixed an issue where Ollama on Linux would use CPU instead of using both the CPU and GPU for GPUs with less memory
- Fixed architecture check in Linux install script
- Fixed issue where leading whitespaces would be returned in responses
- Fixed issue where
ollama showwould show an emptySYSTEMprompt (instead of omitting it) - Fixed issue with the
/api/tagsendpoint would returnnullinstead of[]if no models were found - Fixed an issue where
ollama showwouldn't work when connecting remotely by usingOLLAMA_HOST - Fixed issue where GPU/Metal would be used on macOS even with
num_gpuset to0 - Fixed issue where certain characters would be escaped in responses
- Fixed
ollama servelogs to report the proper amount of GPU memory (VRAM) being used
Note: the EMBED keyword in Modelfile is being revisited until a future version of Ollama. Join the discussion on how we can make it better.
New Contributors
- @vieux made their first contribution in https://github.com/jmorganca/ollama/pull/810
- @s-kostyaev made their first contribution in https://github.com/jmorganca/ollama/pull/801
- @ggozad made their first contribution in https://github.com/jmorganca/ollama/pull/794
- @awaescher made their first contribution in https://github.com/jmorganca/ollama/pull/811
- @deichbewohner made their first contribution in https://github.com/jmorganca/ollama/pull/799
Full Changelog: https://github.com/jmorganca/ollama/compare/v0.1.3...v0.1.4