论文标题
一种可扩展VLSI实现双曲线切线功能的新方法
A Novel Method for Scalable VLSI Implementation of Hyperbolic Tangent Function
论文作者
论文摘要
双曲线切线和乙状结肠功能用作人工和深神经网络中的非线性激活单元。由于这些网络在计算上是昂贵的，因此定制的加速器旨在以较低的成本和功率来实现所需的性能。激活功能和MAC单元是这些神经网络的关键构建块。需要低复杂性和准确的激活功能的硬件实现来满足此类神经网络加速器的性能和区域目标。此外，由于最近的研究表明，DNN可能在不同的层中使用不同的精度，因此需要进行可扩展的实现。本文提出了一种基于硬件实现双曲线功能的三角扩展特性的新方法，可以轻松调整以确定不同的准确性和精度要求。
Hyperbolic tangent and Sigmoid functions are used as non-linear activation units in the artificial and deep neural networks. Since, these networks are computationally expensive, customized accelerators are designed for achieving the required performance at lower cost and power. The activation function and MAC units are the key building blocks of these neural networks. A low complexity and accurate hardware implementation of the activation function is required to meet the performance and area targets of such neural network accelerators. Moreover, a scalable implementation is required as the recent studies show that the DNNs may use different precision in different layers. This paper presents a novel method based on trigonometric expansion properties of the hyperbolic function for hardware implementation which can be easily tuned for different accuracy and precision requirements.
