Week 5, 2025 (Jan 27 - Feb 2)
So erm, this week was mainly about trying to complete my autograd engine project and a little bit of math.
Autograd Engine Project
- completed basic parts: a tensor class, arithmetic, power, matmul, dot, MSE, Linear class, and amongst others
- tried to implement the project in pure Python, but got humbled by broadcasting issues. too difficult for a noob like me
- switched to numpy solely because of the broadcasting errors I couldn't resolve by using pure Python, and this, too, gave me a big headache
- finally managed to get the broadcasting to work, but then I hit a wall with the backprop implementation: gradients were not being computed correctly
- ultimately got the backprop to work, now building some tests to verify everything: arithmetic (add, sub, mul, div), power, matmul, dot, MSE, etc.
Here's the project repo with the latest updates.
Math
I did not do too much math this week since I got quite busy banging my head against the wall due to the autograd project.
But did manage to cross 5000xp in Math Academy!