Despite sparse attention being a known approach for years, DeepSeek claims its version achieves "fine-grained sparse ...
AI’s too pricey right now — fixing chips, software and networks could finally make it fast, cheap, and everywhere.