Technology
'Crazy idea' memory device could slash AI energy consumption by up to 2,500 times
Researchers have developed a new type of memory device that they say could reduce the energy consumption of artificial intelligence (AI) by at least 1,000.
Called computational random-access memory (CRAM), the new device performs computations directly within its memory cells, eliminating the need to transfer data across different parts of a computer.
In traditional computing, data constantly moves between the processor (where data is processed) and the memory (where data is stored) — in most computers this is the RAM module. This process is particularly energy-intensive in AI applications, which typically involve complex computations and massive amounts of data.
According to figures from the International Energy Agency, global energy consumption for AI could double from 460 terawatt-hours (TWh) in 2022 to 1,000 TWh in 2026 — equivalent to Japan’s total electricity consumption.
Related: Intel unveils largest-ever AI 'neuromorphic computer' that mimics the human brain
In a peer-reviewed study published July 25 in the journal npj Unconventional Computing, researchers demonstrated that CRAM could perform key AI tasks like scalar addition and matrix multiplication in 434 nanoseconds, using just 0.47 microjoules of energy. This is some 2,500 times less energy compared to conventional memory systems that have separate logic and memory components, the researchers said.
The research, which has been 20 years in the making, received financial backing from the U.S. Defense Advanced Research Projects Agency (DARPA), as well as the National Institute of Standards and Technology, the National Science Foundation and the tech company Cisco.
-
Technology4h ago
SpaceX's Polaris crew gears up for historic private spacewalk
-
Technology8h ago
The mystic and the mathematician: What the towering 20th-century thinkers Simone and André Weil can teach today’s math educators
-
Technology12h ago
Quantum data beamed alongside 'classical data' in the same fiber-optic connection for the 1st time
-
Technology20h ago
Europe's Jupiter probe to stage daring lunar-Earth fly-by
-
Technology1d ago
Astronomers have warned against colonial practices in the space industry − a philosopher of science explains how the industry could explore other planets without exploiting them
-
Technology1d ago
Could we use volcanoes to make electricity?
-
Technology1d ago
These 'living computers' are made from human neurons — and you can rent one for $500 a month
-
Technology1d ago
Govt faults 'VPN overuse' for internet slowdown