Team IT Security (TSEC) Nachrichtenportal Logo

💾 v0.31.1: mlx: tighten up gemma4 moe loading code (#16964)


Nachrichtenbereich: 💾 Downloads
🔗 Quelle: github.com

This change allows .experts.gate_proj / .up_proj / .down_proj tensor names to each
be used for both quantized (i.e. nvfp4 and mxfp8) and non-quantized (bf16) models.
Previous to this only... [Weiterlesen]

Sharing is caring on Social Media

Reddit
Telegram
LinkedIn
Xing
Twitter
Whatsapp
Facebook
Flipboard

🔧 Running Gemma 4 Inside a Docker Container with GPU Passthrough


📈 897.86 Punkte
🔧 Programmierung

🔧 I Built a Multi-Agent AI Tribunal with Gemma 4


📈 780.11 Punkte
🔧 Programmierung

🔧 5 empty responses from gemma4:e4b. 4 hypotheses. 0 root cause.


📈 721.23 Punkte
🔧 Programmierung

🔧 What did gemma see? - Thinking in comments...


📈 588.76 Punkte
🔧 Programmierung

🔧 Running Gemma 4 26B on GKE with a Single L4 GPU


📈 506.09 Punkte
🔧 Programmierung

🔧 How I Built a Completely Free Local AI Stack — Inspired by a 60-Second YouTube Short


📈 397.41 Punkte
🔧 Programmierung

🔧 Deploy Gemma 4 on Cloud Run: Pay Only When You Actually Use It


📈 384.58 Punkte
🔧 Programmierung

🔧 L.E.N.S. — A private photography coach for blind and low-vision artisans


📈 382.69 Punkte
🔧 Programmierung

🔧 Run Gemma 4 on Your Laptop — A Hands-On Guide to Google's Latest Open Multimodal LLM


📈 264.94 Punkte
🔧 Programmierung

🔧 Shipping Gemma 4 speech recognition in a Windows .NET desktop app: a 5-variant model-selection tour


📈 235.5 Punkte
🔧 Programmierung

🔧 RAG Architecture with n8n + PostgreSQL (pgvector) + Ollama Gemma4 on AWS EC2


📈 235.5 Punkte
🔧 Programmierung

🔧 Basics of Gemma 4 with Google ADK


📈 220.78 Punkte
🔧 Programmierung

🔧 E2B? E4B? 26B A4B? The Gemma 4 Model Names Finally Explained


📈 220.78 Punkte
🔧 Programmierung

🔧 Running Gemma4 for Free on HuggingFace


📈 220.78 Punkte
🔧 Programmierung

🔧 Gemma 4's 128K Context Window: Breaking Down Research Papers Without Cloud APIs


📈 207.95 Punkte
🔧 Programmierung

🔧 Making Gemma 4 (e2b) production-safe with five tiny libraries


📈 206.07 Punkte
🔧 Programmierung

🔧 How to Run Google's Gemma 4 Locally with Ollama — All 4 Model Sizes Compared


📈 206.07 Punkte
🔧 Programmierung

🔧 Gemma 4 VLA chạy cục bộ trên Jetson Orin Nano 8GB


📈 191.35 Punkte
🔧 Programmierung

🔧 Running Gemma 4 Locally with Ollama and OpenCode


📈 191.35 Punkte
🔧 Programmierung

🔧 Gemma 4 Is the First Open Model I'd Actually Recommend to a Client


📈 176.63 Punkte
🔧 Programmierung

🔧 My Local Copilot: Gemma 4 + Open WebUI + OpenHands for Coding Without Leaving My Machine


📈 176.63 Punkte
🔧 Programmierung

🔧 I Tested Every Gemma 4 Model Locally on My MacBook - What Actually Works


📈 176.63 Punkte
🔧 Programmierung

🔧 I asked Gemma 4 to summarize. It said the transcript looked truncated. It was right.


📈 161.91 Punkte
🔧 Programmierung

🔧 Vitreus: Local-First Spreadsheet Intelligence with Gemma 4


📈 152.84 Punkte
🔧 Programmierung

🔧 Ollama Structured Outputs in Practice — Getting Type-Safe JSON from Local LLMs with Pydantic


📈 147.19 Punkte
🔧 Programmierung

🔧 Adding Gemma 4 speech recognition to a .NET desktop app: the llama-server sidecar that survived


📈 147.19 Punkte
🔧 Programmierung

🔧 Building a Fully Offline AI Coding Assistant with Gemma 4 — No Cloud Required 🤖


📈 147.19 Punkte
🔧 Programmierung

🔧 Claude Code with Local LLMs and ANTHROPIC_BASE_URL: Ollama, LM Studio, llama.cpp, vLLM


📈 147.19 Punkte
🔧 Programmierung

🔧 Advanced Loading Bar System with react-redux-loading-bar in React


📈 137.39 Punkte
🔧 Programmierung

🔧 Running OpenAI's gpt-oss-20b with 128k Context on a Single L4 GPU


📈 136.24 Punkte
🔧 Programmierung

🔧 Slaying the Gemma Beast: How We Fixed Local AI and Shipped Search


📈 136.24 Punkte
🔧 Programmierung

🔧 Running a Fully-Local AI Agent on a Mac Studio — OpenClaw + Ollama + MLX


📈 134.35 Punkte
🔧 Programmierung

🔧 StarLens: Gemma 4 as Your Personal Planetarium Guide


📈 134.35 Punkte
🔧 Programmierung

🔧 I Built an AI Interview Coach with Gemma 4 — Zero Backend, 100% Free


📈 132.47 Punkte
🔧 Programmierung

🔧 Gemma4 Tool Calling Fixes in llama.cpp, RTX cuBLAS MatMul Bug, & Local Ollama + Whisper UI


📈 132.47 Punkte
🔧 Programmierung