New todaydeepseek-v4.1VIDEO
DeepSeek V4.1 Flash on a 24GB L4 GPU: 2.34 tok/s
Running the 763B-parameter DeepSeek V4.1 Flash on a 24GB L4 GPU via Strata yields 2.34 tok/s — slow, but notable for fitting a model that size on one card.
Jigs
@debugsenpaiArchived 8 hours agoOriginally posted 2026.10.28
Jigs @debugsenpaiOriginally posted 2026.10.28
Just ran DeepSeek V4.1 Flash on an L4 GPU using Strata. Got 2.34 tok/s. Yeah, it's pretty slow. But running a 763B parameter model on a GPU with just 24GB VRAM is still wild.
x.com/debugsenpai/status/2115279459691675883Archived 2026.10.28 12:04