Reading list

AI时代,我们真的不知道传统的学习方式还会继续吗?

我们有AI Agent + Mattpocock的teach skill,那么我们还需要墨守成规吗?

Math

  • Gilbert Strang MIT 18.06

  • Probability & Statistics

  • Elements of Information Theory

https://ocw.mit.edu/courses/6-050j-information-and-entropy-spring-2008/resources/mit6_050js08_preface/

Computer Science

  • The Elements of Computing Systems (Nand2Tetris)

在硬件和软件两个层面共同搭建并理解整个计算机系统。从基础的HDL逻辑门,到CPU和汇编,再到实现应用层的Teris游戏。一切从零开始,实践性很强,夯中夯。

  • MIT 6.001

based on Structure and Interpretation of Computer Programs (SICP)

ML

  • CS231n

  • CS229 Notes (Linear Algebra & Calculus)

  • Deep Learning: Foundations and Concepts

  • CS330 (Deep Multi-Task & Meta-Learning)

  • High-Dimensional Probability (Vershynin)

  • Karpathy: Zero to Hero

  • CS336 (Language Modeling from Scratch)

  • Algorithms for Optimization (Kochenderfer)

  • Llya Sutskever top 30 reading list

此阅读清单包含了约 30 篇论文与核心文献的合集。Ilya 曾对 Carmack 表示:“如果你真的学透了这批论文,你就掌握了当前深度学习领域 90% 最重要的核心内容。”