OpenAI has unveiled an ambitious plan to surpass Google's infrastructure by developing multi-datacenter training systems. These systems will utilize gigawatt clusters, telecom networking, long haul fiber, hierarchical & asynchronous SGD, and distributed infrastructure winners. However, the significant energy consumption of these data centers is causing strain on the power grid, with electricity permits being a major hurdle for their construction. Issues such as silent data corruption and stragglers are also being addressed.