First-Ever Connect External AMD eGPU to Apple Silicon Mac, Windows, Linux Over USB! | Tiny Corp



AI Summary

In this insightful video by Fahd Mirza, viewers are introduced to a groundbreaking innovation that allows the connection of an external AMD GPU to Apple Silicon Macs over USB 3. This achievement, thanks to Tiny Corp and the Tiny Grad project, addresses the long-standing challenge faced by Mac users, particularly those on Apple silicon, who have been unable to leverage external GPUs for intensive workloads such as AI and ML inference.

The system uses an ADT UT3G adapter and patches firmware to tunnel PCIe over USB 3. While performance over USB 3 is capped at 10 Gbps, clever engineering ensures minimal impact on computational speed, particularly beneficial for AI applications where prompt processing can be a significant bottleneck. This innovation could democratize access to powerful GPU compute for Mac users, making heavier workloads feasible on lighter, more portable devices like the MacBook Air.

Moreover, the open-source nature of this project means it is not restricted to macOS, with potential compatibility for Linux and Windows users as well. Overall, this development may shift the competitive landscape in the GPU market, challenging Nvidia’s dominance and promoting broader affordability and availability of GPUs for various applications.