Acceleration of deep neural networks with the Intel Neural Compute Stick 2

Abstract

This research investigates the efficiency of using the Intel® Neural Compute Stick 2 (NCS2) on the Raspberry Pi platform to accelerate deep learning neural networks. The motivation behind this study is to enable the real-time operation of complex neural networks in embedded systems, potentially reducing the cost of deep learning neural network deployment and expanding industrial applications. Results indicate that, for the specific models used in this experiment, NCS2 improves image recognition performance by approximately 500% and realtime object tracking by around 1500% to 1300%. These findings highlight the significant performance gains NCS2 offers in constrained hardware environments. This suggests its potential for real-time applications such as autonomous systems and smart surveillance. Future research could expand this approach to other low-power devices and refine the models for specific real-world applications.