skip to main content
Language:
Search Limited to: Search Limited to: Resource type Show Results with: Show Results with: Search type Index

Quantization Framework for Fast Spiking Neural Networks

ISSN: 1662-4548 ;EISSN: 1662-453X ;DOI: 10.3389/fnins.2022.918793

Full text available

Citations Cited by
  • Title:
    Quantization Framework for Fast Spiking Neural Networks
  • Author: Furber, Steve ; Li, Chen ; Ma, Lei
  • Subjects: ANN-to-SNN conversion ; fast spiking neural networks ; inference latency ; occasional noise ; quantization ; spiking neural networks
  • Description: Compared with artificial neural networks (ANNs), spiking neural networks (SNNs) offer additional temporal dynamics with the compromise of lower information transmission rates through the use of spikes. When using an ANN-to-SNN conversion technique there is a direct link between the activation bit precision of the artificial neurons and the time required by the spiking neurons to represent the same bit precision. This implicit link suggests that techniques used to reduce the activation bit precision of ANNs, such as quantization, can help shorten the inference latency of SNNs. However, carrying ANN quantization knowledge over to SNNs is not straightforward, as there are many fundamental differences between them. Here we propose a quantization framework for fast SNNs (QFFS) to overcome these difficulties, providing a method to build SNNs with enhanced latency and reduced loss of accuracy relative to the baseline ANN model. In this framework, we promote the compatibility of ANN information quantization techniques with SNNs, and suppress “occasional noise” to minimize accuracy loss. The resulting SNNs overcome the accuracy degeneration observed previously in SNNs with a limited number of time steps and achieve an accuracy of 70.18% on ImageNet within 8 time steps. This is the first demonstration that SNNs built by ANN-to-SNN conversion can achieve a similar latency to SNNs built by direct training. Furber , S , Li , C & Ma , L 2022 , ' Quantization Framework for Fast Spiking Neural Networks ' , Frontiers in Neuroscience , vol. 16 , 918793 , pp. 1-13 . https://doi.org/10.3389/fnins.2022.918793
  • Creation Date: 2022-07
  • Language: English
  • Identifier: ISSN: 1662-4548
    EISSN: 1662-453X
    DOI: 10.3389/fnins.2022.918793
  • Source: Manchester University Research Explorer
    GFMER Free Medical Journals
    PubMed Central
    ProQuest Central
    DOAJ Directory of Open Access Journals

Searching Remote Databases, Please Wait