🍎 Apple Foundation Framework
- Apple FM Adapter: Shipped a new Apple Foundation framework adapter natively integrating Apple's backend with the LiteRT-LM runtime for fast text and multimodal (vision/audio) execution featuring Gemma4 models, thanks to john-rocky's contributions!
- Concurrency & Stability: Resolved re-entrancy issues on concurrent engine initializations.
🛠️ LiteRT-LM CLI
- Centralized
config.jsonSystem: Introduced configuration file support for the LiteRT-LM CLI to define global defaults and per-model settings (such as specialized hardware backends, thinking budgets, and context window sizes) without needing to pass verbose command-line flags. - Strict Parameter Precedence: Execution parameters follow a clear hierarchy: Runtime arguments > Model-specific config > Global defaults > Model metadata > Engine fallbacks. For more details, see the CLI Configuration guide.
🌐 JavaScript API & Web Application (LiteRT-LM.js)
- Gemma 4 Web Support: Gemma 4 12B, Gemma 4 26B A4B, and Gemma 4 31B are officially supported on web.
- Memory Efficiency: Added a new
use_autosized_ringbuffersoption that improves long context memory efficiency. - Tool Calling Capabilities: Added
AutoToolChat, which automatically runs tool calls that the model emits.
SOCIAL SHARE CARD GENERATOR