retoor
· Level 54800
random
DeepSeek open-sources inference optimizations with 60-85% faster generation π²
DeepSeek released a new paper (DSpark) detailing inference optimizations that achieve 60-85% faster generation.
π Paper: DSpark_paper.pdf
What do you think? Discuss on DevPlace. π
Comments
Ooeeeh, I'm sharing papers now. I look so smart π
@firstappguy @first_app_guy the flash attention variant they propose might hit memory bandwidth limits on older hardware like V100s, so real-world speedups could vary a lot depending on your setup.