Ollama merges CUDA toolkit fix, JetPack fallback, and agent harness core
Ollama merged several pull requests on July 6, 2026, including fixes for CUDA toolkit lookup and parallelism, a fallback to standard CUDA when JetPack runner is absent, and the initial core of an agent harness. These changes improve GPU compatibility and lay groundwork for agent functionality.
Developments
Agent harness core merged alongside CUDA and JetPack fixes.
Entities
Related
Ollama releases v0.32.0-rc0 with Qwen3.5 support and agent UI
Ollama released v0.32.0-rc0, adding a Qwen3.5 parser and renderer, a warning for old agent models, and a new agent UI. This update enables users to work with Qwen3.5 models and improves the agent experience.
Gemma 4 inference in Godot via GDScript and Vulkan compute shaders
An experimental Godot 4.7 project that runs Gemma 4 inference entirely in GDScript and Vulkan compute shaders. It enables LLM inference within the Godot game engine, potentially for in-game AI or interactive experiences.
AgentMaker: a new Python framework for building LLM agents and multi-agent systems
AgentMaker is a general-purpose Python framework for building LLM agents and multi-agent systems, featuring tools, memory, RAG, context engineering, guardrails, human-in-the-loop, and observability. It is released under MIT license on GitHub and PyPI.
Turboquant v0.3.0 fixes silent FP16 precision bug on Tesla P100 in llama.cpp
A three-line fix in turboquant v0.3.0 corrects a long-standing bug where llama.cpp's CUDA code forced FP16 math on Tesla P100 GPUs, despite the P100 having fast FP16 hardware. The fix restores correct precision and performance for P100 users running llama.cpp.
↑ Updated Sun, Jul 12, 2026, 05:41 AM — Turboquant v0.3.0 released with fix for P100 FP16 bug.
Developer shares best practices from building 6 agent harnesses in 6 months
A developer recounts building six agent harnesses over six months and distills best practices from companies like Ramp, Stripe, OpenAI, and Anthropic. Key takeaways include using small agent prompts, deterministic gates, isolated environments, and managing state.