"Before you can ask an #AI model to help you [...], the model is born in a #data center. Racks of #servers hum along for months, ingesting #training data, crunching numbers, and performing #computations. [...] It’s only after this #training, when #consumers or #customers “inference” the AI models to get answers or generate outputs, that model makers hope to [...] eventually turn a #profit .[...]
80–90% of computing power for AI is used for inference."
https://www.technologyreview.com/2025/05/20/1116327/ai-energy-usage-climate-footprint-big-tech/