Topic: macos

The ggml/llama.cpp project released version b12018, which includes a fix for f32 to q2_0/q4_0/q5_0 rounding in CPY; this update is important for improving the precision of quantization processes.

Vercel Labs open-sourced agent-desktop, an Apache-2.0 Rust CLI enabling AI agents to interact with computers across macOS, Windows, and Linux by reading accessibility trees. This tool aims to improve AI integration and usability on different operating systems without relying on pixel-based interactions, marking a step forward in accessible AI technology.

marktechpost.com↗

The ggml/llama.cpp project released a new version that includes an update to write KV-cache views in set_tensor, preventing state restores from being dropped. This update is significant as it enhances the stability and functionality of the model, particularly useful for applications requiring continuous inference sessions.

github.com↗

Ollama v0.40.11 adds speech functionality on macOS, allowing text-to-speech generation during model runs and supporting audio streaming via the API, enhancing accessibility and user experience. This update is significant as it broadens Ollama's capabilities, making it more versatile for various applications.

Anthropic has released sandbox-runtime (srt), an open-source OS-level sandbox for restricting access of AI agents and tools on macOS and Linux without using containers. This innovation aims to enhance security by directly managing permissions at the operating system level, crucial for safeguarding against potential risks posed by AI systems.

marktechpost.com↗