Updating Llama Service Configuration | Generated by AI

Home 2026.04

Here’s a summary of what we did:

Service Setup

Config Change | | Before | After | |—|—|—| | Model | DeepSeek-R1-0528-Qwen3-8B-Q4_K_M | gemma-4-E4B-it-Q5_K_M | | Port | 11435 | 8081 | | GPU layers | 99 | 43 | | Context | 8192 | 65536 | | Flash attn | — | off |

Things worth noting


Back Donate