Social icon element need JNews Essential plugin to be activated.
Saturday, May 21, 2022
  • Login
Literary Reviews
  • Home
  • OUR BOOK SHOP
    • Erotic Novels
    • BEST SELLING BOOKS
    • Science Fiction Books
    • Business and Management
    • Computing and IT
    • Cooking
    • Education
    • Religion & Spirituality
    • Self Help
    • Teens & Young Adults
  • Literary Review
  • Literature
  • Book Writing
  • Kindle Publishing
  • Romantic
  • Science Fiction
  • Cooking
  • MORE
    • Erotic
    • Mysteries, Thrillers
    • Literary Themes
    • Business and Management
    • Literary Agents
    • Literary Devices
    • New Books
    • Self Help
    • Teens & Young Adults Novels
    • Computing and IT
    • Education
    • Religion & Spirituality Novels
No Result
View All Result
Literary Reviews
Home Computing and IT

A hyperdimensional computing system that performs all core computations in-memory

admin by admin
July 8, 2020
in Computing and IT
0
A hyperdimensional computing system that performs all core computations in-memory
0
SHARES
4
VIEWS
Share on FacebookShare on Twitter

[ad_1]

A hyperdimensional computing system that performs all core computations in-memory
Credit: Karunaratne et al.

Hyperdimensional computing (HDC) is an emerging computing approach inspired by patterns of neural activity in the human brain. This unique type of computing can allow artificial intelligence systems to retain memories and process new information based on data or scenarios it previously encountered.

Most HDC systems developed in the past only perform well on specific tasks, such as natural language processing (NLP) or time series problems. In a paper published in Nature Electronics, researchers at IBM Research- Zurich and ETH Zurich presented a new HDC system that performs all core computations in-memory and that could be applied to a variety of tasks.

“Our work was initiated by the natural fit between the two concepts of in-memory computing and hyperdimensional computing,” Abu Sebastian and Abbas Rahimi, the two lead researchers behind the study, told TechXplore. “At IBM Research- Zurich, we have been developing in-memory computing platforms based on phase-change memory (PCM), while at ETH Zurich, we have been exploring a brain-inspired computing paradigm called hyperdimensional computing.”

In their past work, the researchers observed that the primary operations involved in HDC, namely encoding and associative memory search, both involve the manipulation and comparison of large distributed patterns within the system’s memory. As a result of this characteristic, these systems can be efficiently fabricated using PCM crossbar arrays, in a way that enables the advantages of analog in-memory computing.

“This tailor-made combination not only avoids the von Neumann bottleneck (aka memory wall), but also significantly improves energy efficiency as well as robustness against variability, noise, and failures,” Sebastian and Rahimi explained. “Almost two years ago, this observation prompted us to initiate a joint research in this direction between ETH and IBM.”

To model neural activity patterns, HDC systems use rich algebra that defines a set of rules to build, bind and bundle different hypervectors. Hypervectors are holographic 10,000-dimensional (pseudo) random vectors with independent and identically distributed components. By using these hypervectors, HDC enables the creation of powerful computing systems that can be used to complete sophisticated cognitive tasks, such as object detection, language recognition, voice and video classification, time series analysis, text categorization and analytical reasoning.

In their paper, Sebastian, Rahimi and their colleagues presented a complete in-memory HDC system that can tackle a variety of tasks. Their system has two key components: an HDC encoder and an associative memory.

“Our system performs core computations in-memory with logical and dot product operations on memristive devices,” Sebastian and Rahimi said. “Due to the inherent robustness of HDC, it was possible to approximate the mathematical operations associated with HDC to make it suitable for hardware implementation and to use analog in-memory computing without compromising the accuracy.”

A hyperdimensional computing system that performs all core computations in-memory
Credit: Nature.

Most in-memory HDC architectures developed in the past are only applicable to a limited set of tasks, such as single language recognition or binary classification tasks. In addition, these systems were primarily evaluated in simulations and used compact models based on small prototypes, with a few resistive devices.

In contrast, the system developed by Sebastian and Rahimi exploits over 700,000 PCM devices. It is thus arguably one of the largest and most significant experimental demonstrations of in-memory HDC presented so far.

The prototype is among the first HDC systems programmed to support different hypervector representations, dimensionalities, as well as types of input symbols and of output classes. This makes it suitable for multiple applications, ranging from NLP to news classification and bio-signal processing.

“Our work truly demonstrates the potential benefits of analog in-memory computing at scale by executing a wide range of classification tasks on the noisy hardware substrate while achieving comparable accuracies to precise software implementations,” Sebastian and Rahimi said. “Such robust analog in-memory computing is accomplished by providing a novel look at data representations, associated operations with graceful approximations, and materials and substrates that naturally enable them.”

The researchers evaluated their system in a series of experiments, testing its performance on three tasks commonly tackled by AI techniques, namely language classification, news classification and hand gesture recognition based on the analysis of electromyography signals. In all of these tasks, their HDC system achieved a near-optimal trade-off between the complexity of a task and the classification accuracy. Sebastian, Rahimi and their colleagues tested their system using 760,000 phase-change memory devices that performed analog in-memory computing processes and found that it achieved similar accuracies to those of popular software techniques.

“We experimentally demonstrated that an HDC platform using PCM-based in-memory computing can achieve over 600% energy savings compared to an optimized digital system based on 65-nm CMOS technology,” Sebastian and Rahimi said.

In the future, the HDC system introduced in this recent study could enable the creation of new technology with advanced memory capabilities that can complete numerous different classification tasks. The system could soon be implemented and tested in a variety of real-world settings, which would allow the researchers to further evaluate its performance.

“In our HDC architecture, the encoding of information and memory storage are separate processes by construction,” Sebastian and Rahimi said. “This key disentanglement is recently appreciated in modern deep neural networks to rescue them from catastrophic forgetting and to enable few-shot learning as well as retaining for a lifetime. Our architecture and representational system will play a central role for the next generation of AI to deliver systems that can learn fast, retain information throughout their lifetime and do this efficiently even with the right materials and substrates.”


A new brain-inspired architecture could improve how computers handle data and advance AI


More information:
Geethan Karunaratne et al. In-memory hyperdimensional computing, Nature Electronics (2020). DOI: 10.1038/s41928-020-0410-3

© 2020 Science X Network

Citation:
A hyperdimensional computing system that performs all core computations in-memory (2020, July 1)
retrieved 8 July 2020
from https://techxplore.com/news/2020-06-hyperdimensional-core-in-memory.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.



[ad_2]

Related posts

A Carbon Crisis Looms Over Supercomputing. How Do We Stop It?

A Carbon Crisis Looms Over Supercomputing. How Do We Stop It?

June 11, 2021
BlackRock Debuts Cloud Computing and 5G Multisector ETF (IDAT)

BlackRock Debuts Cloud Computing and 5G Multisector ETF (IDAT)

June 11, 2021
Tags: computationsComputingcorehyperdimensionalinmemoryperformsSystem
Previous Post

Religion & Spirituality Books Preview: March 2020

Next Post

Beardwood’s first novel shines light on education

Next Post
Beardwood’s first novel shines light on education

Beardwood’s first novel shines light on education

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

RELATED PRODUCTS

  • The Miracle Morning: The 6 Habits That Will Transform Your Life Before 8AM The Miracle Morning: The 6 Habits That Will Transform Your Life Before 8AM £3.50
  • Business Analysis for Practitioners: A Practice Guide Business Analysis for Practitioners: A Practice Guide £10.95
  • If These Walls Could Talk (Joe Boyd Suspense Series Book 1) If These Walls Could Talk (Joe Boyd Suspense Series Book 1) £2.99
  • Think and Grow Rich Think and Grow Rich £0.99
  • All Out: The No-Longer-Secret Stories of Queer Teens Throughout the Ages All Out: The No-Longer-Secret Stories of Queer Teens Throughout the Ages £13.34

PRODUCT CATEGORIES

  • Best Selling Books
  • Erotic
  • Science Fiction Books
  • Cooking
  • Business and Management
  • Education
  • Computing and IT
  • Religion & Spirituality
  • Teens & Young Adults
  • Self Help
  • Mysteries, Thrillers & Suspense
  • Romance Books

Recent News

  • The Recorder – New books ‘popping up’ at Cushman Library in Bernardston
  • 8 of the Best Romantic Novels About Breakups
  • Studio B Combines Visual, Literary Art in “My Favorite Things: Beauties Are Joys Forever”

Category

  • Book Writing
  • Business and Management
  • Computing and IT
  • Cooking Books
  • Education
  • Erotic
  • Kindle Publishing
  • Literary Agents
  • Literary Devices
  • Literary Review
  • Literary Themes
  • Literature
  • Mysteries, Thrillers & Suspense
  • New Books
  • Religion & Spirituality
  • Romantic Novels
  • Science Fiction
  • Self Help
  • Home
  • OUR BOOK SHOP
  • Literary Review
  • Literature
  • Book Writing
  • Kindle Publishing
  • Romantic
  • Science Fiction
  • Cooking
  • MORE

© 2020 literaryreviews

No Result
View All Result
  • Home
  • OUR BOOK SHOP
    • Erotic Novels
    • BEST SELLING BOOKS
    • Science Fiction Books
    • Business and Management
    • Computing and IT
    • Cooking
    • Education
    • Religion & Spirituality
    • Self Help
    • Teens & Young Adults
  • Literary Review
  • Literature
  • Book Writing
  • Kindle Publishing
  • Romantic
  • Science Fiction
  • Cooking
  • MORE
    • Erotic
    • Mysteries, Thrillers
    • Literary Themes
    • Business and Management
    • Literary Agents
    • Literary Devices
    • New Books
    • Self Help
    • Teens & Young Adults Novels
    • Computing and IT
    • Education
    • Religion & Spirituality Novels

© 2020 literaryreviews

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In