The writer is a research scientist and climate lead at open-source AI platform Hugging Face
With every query, image generation and chatbot conversation, the energy that is being consumed by artificial intelligence models is rising. Already, emissions by data centres needed to train and deliver AI services are estimated at around 3 per cent of the global total, close to those created by the aviation industry.
But not all AI models use the same amount of energy. Task-specific AI models like Intel’s TinyBERT and Hugging Face’s DistilBERT, which simply retrieve answers from text, consume minuscule amounts of energy — about 0.06 watt-hours per 1,000 queries. This is equivalent to running an LED bulb for 20 seconds.