Tesla's specialized AI supercomputer, known as Dojo, is so potent that it overloaded the power grid. Initially showcased at Tesla's AI Day the prior year, Dojo was in its nascent stage. However, at the AI Day of 2022, Tesla demonstrated the significant advancements made with Dojo.

The supercomputer evolved from mere chips and training tiles to a complete cabinet. Tesla asserts that one Dojo tile can replace six GPU boxes at a lower cost. Each tray contains six Dojo tiles, equating to "three to four fully-loaded supercomputer racks." Two trays can fit into a single Dojo cabinet alongside a host assembly.

The substantial power consumption of Dojo led to grid tripping in Palo Alto. Tesla had to construct custom infrastructure with high-powered cooling and power systems to support Dojo's operations.

An 'ExaPOD', comprising several Dojo cabinets, boasts impressive specifications: 1.1 EFLOP, 1.3TB SRAM, and 13TB DRAM. Seven ExaPODs are planned for housing in Palo Alto.

Dojo's purpose is AI-focused, significantly enhancing Tesla's capacity to train neural networks using vehicle video data, crucial for self-driving endeavors and its humanoid robot, Optimus.

Optimus, unveiled alongside Dojo, has progressed from a mere concept to a functioning prototype capable of basic tasks like plant watering. Although it's evident that Optimus has a long journey ahead to fulfill Tesla's envisioned capabilities, progress has been made, with CEO Elon Musk expressing optimism about its future development within the next few months or years, with an anticipated cost below $20,000.