https://minamism.com/tags/triton/Recent content in Triton on minamismHugoen-USFri, 25 Sep 2026 05:00:00 +0900https://minamism.com/posts/flash-next-vllm-optimization/Fri, 25 Sep 2026 05:00:00 +0900https://minamism.com/posts/flash-next-vllm-optimization/Qwen3.8-Flash-Next ran at 80 tok/s last time. Once it went into real use, first-request TTFT was 100 seconds, prefix caching cut the context by 30%, and decode in the production configuration was in the 60s, not 80. This covers the 11 patches added to reach 95-99 tok/s single-stream, 243 tok/s with four streams, image input and MTP, and the approaches that were tested and not adopted.