“If we’re just scaling without any regard to the environmental impacts, we can get ourselves into a situation where we are doing more harm than good with machine learning models,” Stanford researcher ​​Peter Henderson said last year. “We really want to mitigate that as much as possible and bring net social good.”

AI models are undoubtedly data-hungry, but the Stanford report notes it may be too early to say whether or not that necessarily means they portend an environmental disaster. Powerful AI models in the future could be used to optimize energy consumption in datacenters and other environments. In one three-month experiment, for example, DeepMind’s BCOOLER agent was able to achieve around 12.7% energy saving in a Google data center while still keeping the building cool enough for people to comfortably work.

AI’s environmental costs mirror the crypto climate dilemma

If all of this sounds familiar, it’s because we basically saw this same environmental dynamic play out several years ago with tech’s last big obsession: Crypto and web3. In that case, Bitcoin emerged as the industry’s obvious environmental sore spot due to the vast amounts of energy needed to mine coins in its proof of work model. Some estimates suggest Bitocin alone requires more energy every year than Norway’s annual electricity consumption.

Advertisement

Years of criticism from environmental activists however led the crypto industry to make some changes. Ethereum, the second largest currency on the blockchain, officially switched last year to a proof of stake model which supporters claim could reduce its power usage by over 99%. Other smaller coins similarly were designed with energy efficiency in mind. In the grand scheme of things, large language models are still in their infancy and it’s far from certain how its environmental report card will play out.

Large language models are getting absurdly expensive

Image for article titled Move Aside, Crypto. AI Could Be The Next Climate Disaster.
Screenshot: “The AI Index 2023 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, Stanford, CA
Advertisement

Energy requirements aren’t the only figures shooting up with new LLMs. So are their price tags. When OpenAI released GPT 2 back in 2019, the Stanford report notes it cost the company just $50,000 to train its model built on 1.5 billion parameters. Just three years later Google revealed its own powerful PaLM model trained on 540 billion parameters. That model costs $8 million to train. PaLM, according to the report, was around 360 times larger than GPT-2 and but cost 160 times more. Again, these models, either released by OpenAI or Google, are only getting larger.

“Across the board, large language and multimodal models are becoming larger and pricier,” the report notes.

Advertisement

All that money could have carry-over effects in the wider economy. Stanford estimates the amount of private investment in AI globally in 2022 was 18 times larger than it was in 2013. AI-related job postings across every sector, in the US at last, are also growing, and increased from 1.7% to 1.9% in 2022. On the global scale, the US remains unmatched in terms of overall investment in AI and reportedly invested $47.4 billion into AI tech in 2022. That.s 3.5 times more than China, the next largest spender. When it comes to burning money, America is unmatched.

Lawmakers try to play catchup

The recent wave of powerful chatbots and ethical and legal questions surrounding them snuck up on just about everyone outside of AI engineers, including lawmakers. Slowly but surely, lawmakers are trying to play legislative catch-up. In 2021, according to the Stanford report, just 2% of all federal bills involving AI actually passed into law. That figure climbed up to 10% last year. Many of those bills similarly were written prior to the current hysteria around GPT4 and some researcher’s premature descriptions of it as “artificial general intelligence.”

Advertisement

Lawmakers are also more interested in AI than ever before. In 2022, Stanford identified 110 AI-related legal cases brought in US federal and state courts. That might not sound like much, but it’s still 6.5 times more cases than were spotted in 2016. The majority of those cases took place in California, Illinois, and New York. Around 29% of those AI cases involved civil law, while 19% concerned intellectual property rights. If recent complaints lodged by writers and artists over AI generators’ use of their style are any guide, it’s possible that the portion of property rights cases could increase.

Want to know more about AI, chatbots, and the future of machine learning? Check out our full coverage of artificial intelligence, or browse our guides to The Best Free AI Art Generators and Everything We Know About OpenAI’s ChatGPT.