Team IT Security (TSEC) Nachrichtenportal Logo

💾 v0.31.2: llm: allow iGPU mmproj offload with fit padding (#16996)


Nachrichtenbereich: 💾 Downloads
🔗 Quelle: github.com

llm: allow iGPU mmproj offload with fit padding

llama.cpp's fit pass sizes text-model placement before the multimodal projector is loaded. Ollama had been avoiding that risk on non-Metal iGPUs by... [Weiterlesen]

Sharing is caring on Social Media

Reddit
Telegram
LinkedIn
Xing
Twitter
Whatsapp
Facebook
Flipboard

🔧 Gemma 4 VLA chạy cục bộ trên Jetson Orin Nano 8GB


📈 550.4 Punkte
🔧 Programmierung

🔧 ~21 tok/s Gemma 4 on a Ryzen mini PC: llama.cpp, Vulkan, and the messy truth about local chat


📈 271.17 Punkte
🔧 Programmierung

🔧 Cost-Effective Self-Hosting with Plex: Balancing Performance and Ease of Use


📈 145.04 Punkte
🔧 Programmierung

🔧 Cruel AI Marketing: Why the Latest HX 370 is Still No Match for a 5-Year-Old 2060 Super


📈 145.04 Punkte
🔧 Programmierung

🔧 Vellum — a private, on‑device screenshot assistant powered by Gemma 4


📈 104.84 Punkte
🔧 Programmierung

🔧 Deploying Gemma 4 26B on Proxmox: IaC Setup with Terraform, Ansible & AMD iGPU


📈 101.53 Punkte
🔧 Programmierung

🐧 Snapdragon X2 Elite Extreme: Ubuntu 26.04 PPD Results and Adreno iGPU Wall


📈 101.53 Punkte
🐧 Linux Tipps

🔧 Setting Up Dual GPU Gaming Laptops in Hyprland


📈 101.53 Punkte
🔧 Programmierung

🔧 Scrapy Rules: A Complete Beginner's Guide (With Real Examples)


📈 90.95 Punkte
🔧 Programmierung

🔧 Scrapy Rules: A Complete Beginner's Guide (With Real Examples)


📈 90.95 Punkte
🔧 Programmierung

🔧 The Complete Beginner's Guide to vpcctl: Building Virtual Networks on Linux


📈 86.91 Punkte
🔧 Programmierung

💾 v0.31.2: llm: allow iGPU mmproj offload with fit padding (#16996)


📈 85.47 Punkte
💾 Downloads

💾 v0.31.2-rc2: llm: allow iGPU mmproj offload with fit padding (#16996)


📈 85.47 Punkte
💾 Downloads

🔧 Local Multimodal LLM on iOS with `llama.cpp` (Swift + ObjC++)


📈 78.63 Punkte
🔧 Programmierung

🔧 Web Security 101- From SOP to CORS: Understanding the Web’s Cross‑Origin Security Model


📈 74.78 Punkte
🔧 Programmierung

🔧 Setup Firewall on Linux


📈 72.76 Punkte
🔧 Programmierung

🔧 Setup Dev Environment: Laptop iGPU 2026 vs RTX 4050 45W


📈 72.52 Punkte
🔧 Programmierung

🔧 Why DDR5 Bandwidth Kills Dual-LLM Inference on APUs (Benchmarks Inside)


📈 72.52 Punkte
🔧 Programmierung

🔧 Architecture vs Brute-Force: What I Learned Benchmarking KDFs for my Thesis


📈 72.52 Punkte
🔧 Programmierung

🔧 Development of Real-Time Remote Desktop App


📈 72.52 Punkte
🔧 Programmierung

🔧 Azure Kubernetes Service (AKS) Network Policies: A Comprehensive Guide


📈 70.74 Punkte
🔧 Programmierung

📰 Proactive Preparation and Hardening Against Destructive Attacks: 2026 Edition


📈 66.7 Punkte
📰 IT Security Nachrichten

🔧 CORS não é detalhe: por que times ainda erram esse básico


📈 64.68 Punkte
🔧 Programmierung

🔧 Building a Reusable VPC, Subnets, and Firewall Rules Module


📈 62.65 Punkte
🔧 Programmierung

🔧 Build Production-Ready GCP Infrastructure from Scratch Part 01


📈 62.65 Punkte
🔧 Programmierung

🕵️ Hack Smarter — City Council (Active Directory)


📈 60.63 Punkte
🕵️ Hacking

🔧 Networking for DevOps and SDLC(Software Development Lifecycle) — The Complete Hands-On Beginner-to-Advanced Guide (Week 3)


📈 58.61 Punkte
🔧 Programmierung

🐧 Tried to use something other than ubuntu


📈 58.02 Punkte
🐧 Linux Tipps

📰 Intel Is Making Its Own Handheld Gaming PC Chips At CES 2026


📈 58.02 Punkte
📰 IT Security Nachrichten

🐧 Linux is a meme on some older computers, dont be tricked into thinking it'll save them all


📈 58.02 Punkte
🐧 Linux Tipps

🔧 How I Built a Self-Managing AI Lab with Hermes Agent on a Intel Arc GPU


📈 58.02 Punkte
🔧 Programmierung

🔧 Frontend System Design : Frontend Security — Guide


📈 56.59 Punkte
🔧 Programmierung

🔧 Understanding CORS: A Practical Guide


📈 56.59 Punkte
🔧 Programmierung

🔧 Linux Firewall Configuration with UFW and iptables


📈 54.57 Punkte
🔧 Programmierung

🔧 50 React Interview Coding Challenges


📈 54.57 Punkte
🔧 Programmierung