Deep learning has a terrible carbon footprint

Carbon Footprint, Source onlygfx.com

2019-06-10

One of the pressing problems to be solved until 2030, is the climate change and the transformation of current technologies towards zero emission. This must be seen in the light that among others the EU member states have signed the 2015 Paris Climate Agreement. The question now is whether computer science (CS) is part of the solution or part of the problem. It turns out that CS, especially the growth in AI applications will tremendously increase the demand for supercomputing capacity. This, in combination with blockchain technology, has the tendency that energy consumption by digital technology will go through the roof. There are predictions that by 2040 the energy required for computation will have exceeded the world energy production unless we find energy saving technologies that add up to the problem.

A recent article in the MIT Technology Review /1/ reports about the carbon print caused by artificial intelligence shows the current limitation of this technology.

The artificial-intelligence industry is often compared to the oil industry: once mined and refined, data, like oil, can be a highly lucrative commodity. Now it seems the metaphor may extend even further. Like its fossil-fuel counterpart, the process of deep learning has an outsize environmental impact.

In new paper, /2/ researchers at the University of Massachusetts, Amherst, performed a life cycle assessment for training several common large AI models. They found that the process can emit more than 626,000 pounds of carbon dioxide equivalent—nearly five times the lifetime emissions of the average American car (and that includes manufacture of the car itself).

As a consequence

  • Research is therefore needed in the field of chips and processors with at least an order of magnitude less energy consumption
  • Research is needed in the field of high performance operating systems (may be special purpose) that deliver results faster at lower (energy-)costs.
  • May be an interdisciplinary approach between CS and the semiconductor industry should be pursued to address the issues to minimize energy consumption.
  • We have also to address the problem of waste. We need to develop technologies that deal with end-of-live processing of computing equipment. Both in terms of reuse of materials (such as precious metals) as well as avoidance of soil pollution with the leftovers.

MIT Technology Review:

https://www.technologyreview.com/s/613630/training-a-single-ai-model-can-emit-as-much-carbon-as-five-cars-in-their-lifetimes/

Research Paper “Energy and Policy Considerations for Deep Learning in NLP”, by Emma StrubellAnanya GaneshAndrew McCallum

https://arxiv.org/abs/1906.02243

 

[Total: 0    Average: 0/5]

Gerhard Schimpf, the recipient of the ACM Presidential Award 2016, has a degree in Physics from the University of Karlsruhe. As a former IBM development manager and self-employed consultant for international companies, he has been active in ACM for over four decades. He was a leading supporter of ACM Europe, serving on the first ACM Europe Council in 2009. He was also instrumental in coordinating ACM’s spot as one of the founding organizations of the Heidelberg Laureates Forum. Gerhard Schimpf is a member of the German Chapter of the ACM (Chair 2008 – 2011) and a member of the Gesellschaft für Informatik. --oo-- Gerhard Schimpf, der 2016 mit dem ACM Presidential Award geehrt wurde, hat an der TH Karlsruhe Physik studiert. Als ehemaliger Manager bei IBM im Bereich Entwicklung und Forschung und als freiberuflicher Berater international tätiger Unternehmen ist er seit 40 Jahren in der ACM aktiv. Er war Gründungsmitglied des ACM Europe Councils und gehört zum Founders Club für das Heidelberg Laureate Forum, einem jährlichen Treffen von Preisträgern der Informatik und Mathematik mit Studenten. Gerhard Schimpf ist Mitglied des German Chapter of the ACM (Chairperson 2008 – 2011) und der Gesellschaft für Informatik.


Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

WP Facebook Auto Publish Powered By : XYZScripts.com