Baseten publishes a Rust and CUDA engine for DeepSeek V4.1 Flash, citing 2,060 tokens a second
Baseten says its engine decodes 2,060 tokens a second on eight B300 GPUs, with a 1M-token prefill in 11.7 seconds. The code is…
Topic
Baseten says its engine decodes 2,060 tokens a second on eight B300 GPUs, with a 1M-token prefill in 11.7 seconds. The code is…