Topic: apple silicon

The ggml/llama.cpp project released version b12018, which includes a fix for f32 to q2_0/q4_0/q5_0 rounding in CPY; this update is important for improving the precision of quantization processes.

Ollama released version 0.40.13 of its LFM3 models, enabling text-to-speech functionality on both Linux and Windows in addition to existing platforms, expanding accessibility for users across different operating systems. This update is significant as it broadens the user base and compatibility of Liquid AI's advanced language models.

The ggml/llama.cpp project released a new version that includes an update to write KV-cache views in set_tensor, preventing state restores from being dropped. This update is significant as it enhances the stability and functionality of the model, particularly useful for applications requiring continuous inference sessions.

github.com↗

The ggml/llama.cpp project has released a new version with server entrypoint refactoring, aimed at improving the server role functionality. This update is significant as it enhances the backend capabilities, potentially boosting performance and usability for users on various platforms.