Posts on minamismhttps://minamism.com/posts/Recent content in Posts on minamismHugoen-USThu, 10 Sep 2026 06:00:00 +09003.14M Context on 3x 3090: The Power of an Architecture That Puts KV Cache in Host RAMhttps://minamism.com/posts/qsa-kv-offload/Thu, 10 Sep 2026 06:00:00 +0900https://minamism.com/posts/qsa-kv-offload/Qwen Sparse Attention reads the same number of tokens per step no matter how long the context is. Thanks to this, the KV cache can be placed in host RAM. With the same three GPUs, the upper limit went from 234k to 3.14M tokens.