Archives
- 16 Sep Weight Initialization in Deep Neural Networks
- 16 Sep Position Encoding
- 15 Sep Adam Optimizer
- 07 Sep Robotics Dataset Problems
- 07 Sep General-Purpose Robot Roadmap
- 07 Sep Embodied AI Paper Reviews
- 21 Jul System Design Template
- 21 Jul Register Buffer
- 12 Jul Reinforcement Learning Review Notes
- 17 Feb Deep Learning Training Tricks
- 17 Feb Mixed precision training
- 17 Feb Secret Sauce of Distributed Deep Learning - Ring-All-Reduce
- 17 Feb Parallelisms in Large Scale Deep Learning
- 17 Feb Another 2 ways of regularization, Label Smoothing and Weight Tying
- 13 Feb Scaling in Dropout and Transformer Attention Block
- 24 May Machine Learning Notes
- 16 May Algorithm Notes
- 19 Aug Binary Heap