I keep seeing stuff about TPU, has anything materially new happened? There’s no evidence Google has ever trained a Gemini on non-TPU hardware, going years back to pre-GPT models like BERT. TPUs predate Nvidia’s own tensor cores. Anthropic (and Character, and SSI, and Midjourney, …) have long used TPUs, I’d be surprised if Meta *weren’t* looking at them. Nvidia’s moat has never been deep for the big labs - see OpenAI deciding it could do better than CUDA and investing in Triton instead, regularly edging out CUDNN on benchmarks. There is nothing magical or structural about any of this, just good engineers doing good work. TPUs are not all that more efficient than GPUs, and small perf/W differences are dwarfed by whether Meta has the right kernels / systems engineering talent to pull it off. Both Nvidia’s and Google’s moats are small and we still are at the point where individual good engineers can flip the entire balance. See old thread below. Was this just… not priced in? This is all super old public info.