Learnwithai Graphic Banner 1080

AI's impact on energy and water usage

Version 1.7 by Jon Ippolito for Learning With AI

Cooling towersIt's hard to keep up with studies of the energy impact of generative AI, so here are nine takeaways from the sources I have personally found most illuminating.

This list aims for a "just the facts" approach that sidesteps the dueling interpretations of AI champions and critics. I'm also using one set of measures rather than comparing apples to oranges, specifically:

This list assesses only energy and water usage, and not actual environmental impact. I'm neither a climate scientist nor an electrical engineer; these are only my rough estimates based on academic studies, industry reports, or back-of-the envelope calculations. It's unclear how some future tradeoffs will play out, eg whether improved efficiencies will cancel out increased demand. This list also excludes numerous potential AI downsides apart from environmental risks, which you can find explained in the IMPACT RISK framework.

I welcome suggestions of research that updates or contradicts these findings. You can find a log of recent updates here.

9 takeaways from recent research

  1. πŸ™ˆ1. Lack of transparency by AI companies means usage calculations at this point are only estimates.
  2. 🌍2. Water and energy impacts are extremely localized; eg the stress on Ireland's water and grid is much higher than Norway's due to the latter's hydropower and cool climate.
  3. πŸ”Œ3. Large models consume disproportionately more energy and water than smaller ones.
  4. πŸ‹οΈ4. Training consumes more energy and water than inference (prompting).
  5. πŸ›5. Policy changes by new administrations can result in more or less climate impact for the same energy consumption.
  6. πŸ“Š6. Data centers are currently 2% of global energy demand (Ritchie 2024).
  7. πŸ’»7. Prompting a local model on a laptop requires no water and uses 1-10% of the energy of prompting a model in a data center.
  8. 🚰8. Cooling a data center requires about 4 cubic centimeters of water per watt-hour regardless of task (Lawrence 2024).
  9. βš–οΈ9. Comparisons can be surprising (approximate Watt-hours and liters or ccs):
  10. ⚠️ Please do not quote any of these figures without this caveat: "These are guesses based on incomplete and often contradictory sources."


Sources

Public domain cooling tower photograph via picryl.com (CC0).