bloated PyTorch general purpose tooling aimed at data-scientists now needs a rethink. Throwing more compute at the problem was never a solution to anything. The silo’ing of the cs and ml engineers resulted in bloating of the frameworks and tools, and inefficient use of hw.

Deepseek shows impressive e2e engineering from ground up and under constraints squeezing every ounce of the hardware and network performance.