Articles tagged with Kernel Tuning

Running 70B Models on CPU-Only Fedora: Kernel Tuning Guide

How to tune the Linux kernel and memory architecture to achieve 15 tokens/second with Llama 3.3 70B on standard Intel CPU hardware.