In a first, Google has released data on how much energy an AI prompt uses
1 min read
Summary
Google has released a technical document that reveals the energy used by its AI-powered chatbot, Gemini.
The report shows that, on average, a single prompt uses 0.24wh of electricity – enough to run a microwave for one second, and also reveals estimates for associated water use and carbon emissions.
While the company’s AI chips account for 58% of the energy used, much of the remaining energy is used by the infrastructure needed to operate the chips.
The report reveals that energy consumed per query has fallen dramatically over time and Google suggests this is due to advancements in models and software optimisations.
It has also estimated the greenhouse gas emissions associated with the average query.
This is the most transparent estimate from a major tech company with a popular AI product and provides detailed information on how the company arrived at its conclusions.