Neuromorphic Computing Hala Point: Intel builds the largest neuromorphic network to date

From Susanne Braun | Translated by AI 3 min Reading Time

Related Vendors

Researchers at Sandia National Laboratories are using the world's largest neuromorphic network to date, built on the basis of Intel's Loihi-2 processors. Compared to the previous generation of the network, Hala Point achieves a tenfold increase in neuron capacity, resulting in a twelvefold increase in performance.

Hala Point integrates processing, storage, and communication channels in a massively parallel structure and offers a storage bandwidth of a total of 16 petabytes per second (PB/s), a communication bandwidth of 3.5 PB/s between the cores, and a communication bandwidth of 5 terabytes per second (TB/s) between the chips. The system can process over 380 trillion 8-bit synapses and over 240 trillion neuron operations per second.(Image: Intel Corporation)
Hala Point integrates processing, storage, and communication channels in a massively parallel structure and offers a storage bandwidth of a total of 16 petabytes per second (PB/s), a communication bandwidth of 3.5 PB/s between the cores, and a communication bandwidth of 5 terabytes per second (TB/s) between the chips. The system can process over 380 trillion 8-bit synapses and over 240 trillion neuron operations per second.
(Image: Intel Corporation)

Especially when it comes to the efficiency and parallel processing capability of artificial intelligence, developers cannot avoid getting their inspiration for their network architecture from one of nature's most efficient computers: the human brain. Characteristics of the human brain, such as the mentioned efficiency, the ability for asynchronous, event-based processing, learning and adaptability, inspire the development of AI systems, primarily neuronal and neuromorphic systems.

A neuromorphic system named Hala Point has recently been used at Sandia National Laboratories and it is the largest of its kind. It was built from over 1,000 Intel Loihi-2 processors. This is an advancement of the large-scale research system Pohoiki Springs, realized by Intel in 2019, which also used neuromorphic chips. Architectural improvements of Hala Point provide a tenfold increase in neuron capacity and a twelvefold increase in performance compared to its predecessor.

Gallery
Gallery with 5 images

Why did Intel opt for a neuromorphic network? The answer is relatively simple: AI models require a large amount of computing power. "That's why we developed Hala Point, which combines the efficiency of deep learning with novel, brain-inspired learning and optimization features," says Mike Davies, director of the Neuromorphic Computing Lab at Intel Labs.

What does Hala Point bring to the table?

According to statements from Intel Labs, the neuromorphic system is capable of performing up to 20 quadrillion operations per second or supporting 20 petaops "with an efficiency exceeding 15 trillion 8-bit operations per second per watt (TOPS/W) when executing conventional deep neural networks." Hala Point could enable continuous real-time learning for AI applications such as scientific and technical problem solving, logistics, smart-city infrastructure management, and more in the future.

Hala Point uses 1,152 neuromorphic Loihi-2 processors to boost energy efficiency and performance. The compact overall package supports up to 1.15 billion neurons and 128 billion synapses, distributed over 140,544 neuromorphic computing cores and consuming a maximum of 2,600 watts of power. Additional computations can be made with more than 2,300 x86 processors.

With a total memory bandwidth of 16 petabytes per second and a processing speed of over 240 trillion neuron operations per second, Hala Point is extremely powerful. Using Loihi-based systems, AI inference and optimization problems can be solved with 100 times less energy and up to 50 times faster than traditional CPU and GPU architectures.

"When applied to bio-inspired spiking neural network models, the system can execute its full capacity of 1.15 billion neurons 20 times faster than a human brain, and up to 200 times faster at lower capacity. Although Hala Point is not intended for neuroscientific modeling, its neuron capacity is roughly equivalent to an owl's brain or the cortex of a Capuchin monkey," explain the designers.

Hala Point in bullet points

  • 1,152 Loihi-2 processors manufactured on the Intel 4 process node,

  • are housed in a six-rack enclosure the size of a microwave.

  • The system supports up to 1.15 billion neurons and 128 billion synapses.

  • They are distributed over 140,544 neuromorphic computing cores and consume a maximum of 2,600 watts of power.

  • Hala Point offers a total memory bandwidth of 16 petabytes per second (PB/s),

  • a communication bandwidth of 3.5 PB/s between the cores,

  • and a communication bandwidth of 5 terabytes per second (TB/s) between the chips.

  • The system can process over 380 trillion 8-bit synapses and over 240 trillion neuron operations per second

  • By exploiting a sparse connectivity of up to 10:1 and event-driven activity, early results for Hala Point show that the system can achieve an efficiency of up to 15 TOPS/W2 for deep neural networks without needing to batch input data.

The future of Hala Point

Researchers at Sandia National Laboratories plan to use Hala Point for research in the area of advanced brain-scale computing. The organization will focus on solving computational science problems in the fields of device physics, computer architecture, computer science and informatics.

Subscribe to the newsletter now

Don't Miss out on Our Best Content

By clicking on „Subscribe to Newsletter“ I agree to the processing and use of my data according to the consent form (please expand for details) and accept the Terms of Use. For more information, please see our Privacy Policy. The consent declaration relates, among other things, to the sending of editorial newsletters by email and to data matching for marketing purposes with selected advertising partners (e.g., LinkedIn, Google, Meta)

Unfold for details of your consent

Neuromorphic computing is based on insights from neuroscience and integrates memory and computing power with high parallelism to minimize data movement - thus enabling energy savings in the gigawatt-hour range, as regular retraining with ever-growing datasets is eliminated.

Recent trends in the scaling of deep learning models have highlighted the challenges of AI sustainability and underscored the necessity of innovative approaches in hardware architecture. Results published this month at the International Conference on Acoustics, Speech, and Signal Processing (ICASSP) show that Loihi 2 has substantially improved the efficiency, speed, and adaptability of edge workloads. (sb)