InternVideo2.5
Technical report reading of InternVideo2.5
Paper Reading
DeepSeek-V3 Technical Report
Paper Reading of DeepSeek-V3 Technical Report
DeepSeekMoE
Paper Reading of DeepSeekMoE
DeepSeekMLA
Principle of DeepSeekV3 MLA
Fast-dLLM
Paper Reading of Fast-dLLM
LLaDA
Paper Reading of LLaDA
Transformer Family
Introduction of Transformer Family
ZeRO, ZeRO-Offload, ZeRO-Infinity
Paper reading of ZeRO.
All2All Communication Cost
Introduction of Transformer Family
DistriFusion
Paper reading about DistriFusion.