Live Demonstration: Improving efficiency of speech recognition with neuro-inspired units on AIU Spyre

This demonstration implements efficient speech recognition through the use of biologically-inspired units implemented on the recently introduced Artificial Intelligence Unit (AIU Spyre). Speech recognition models approach human-level accuracy, but are significantly more power-hungry compared to the human brain. Efficient biological processes can be incorporated into deep learning models substantially reducing the computational cost and inference time. Simultaneously, novel chips, such as the AIU Spyre are designed from the ground up for energy-efficient execution of artificial neural networks. We demonstrate the scalability and efficiency of our neuro-inspired speech model through an implementation on the AIU Spyre.