Essays, field notes, and technical logs.
I had long known that there is a remarkable figure in the field of deep learning named Andrej Karpathy. Last week, I watched his two-hour video on building...
Step 0: The Micro-Network Blueprint
Building a neural network for MNIST digits from scratch using only NumPy requires pulling back the abstractions of modern frameworks. Below is the end-to-end...
I want to talk about some thoughts I've had about learning English—or you could generalize this to learning any language.
When you build your own programming language from scratch, your test suite is your mirror. Everything works in isolated unit tests until you write a classic...
In static programming languages like C, variable types are fixed at compile time (int, double, char). In dynamic programming languages (like Python, Lua, or...
Lexer — source text → token stream Parser — token stream → AST Codegen — AST → assembly (or direct evaluation)
What Does a Linker Actually Do? A Hands-On Linker Script Experiment
We hope AI can accelerate productivity and free our hands. But on the other hand, at the current stage, AI/LLMs still cannot reliably complete all coding...
But this neuron is not a biological neuron—it is merely inspired by the brain. A neuron receives multiple inputs (X) and finally outputs a weighted sum.
