Large Scale AI on Apple Silicon (as mentioned by @AndrejKarpathy ) — Alex Cheema, EXO Labs
AI Summary
Talk about the history of scientific rigor, questioning assumptions, and the hardware lottery in AI development. Highlights include the story of Max Planck’s quantization, the Milikan experiment, and the challenges of scientific progress. Discusses the evolution of backpropagation and CNNs, and the impact of hardware on AI research directions. Introduces Exo, an orchestration layer for AI hardware, and the importance of publishing all data, good or bad, for scientific progress.