Home > Mechanical > New Hybrid Module Makes Deep Neural Networks Smarter

New Hybrid Module Makes Deep Neural Networks Smarter

Artificial intelligence researchers at North Carolina State University have improved the performance of deep neural networks by combining feature normalization and feature attention modules into a single module that they call attentive normalization (AN). The hybrid module improves the accuracy of the system significantly, while using negligible extra computational power.

To test their AN module, the researchers plugged it into four of the most widely used neural architectures: ResNets, DenseNets, MobileNetsV2 and AOGNets. They then tested the networks against two industry standard benchmarks: the ImageNet-1000 classification and the MS-COCO 2017 object detection and instance segmentation benchmark.

“We found that AN improved performance for all four architectures on both benchmarks,” Wu says. “For example, top-1 accuracy in the ImageNet-1000 improved by between 0.5% and 2.7%. And Average Precision (AP) accuracy increased by up to 1.8% for bounding box and 2.2% for semantic mask in MS-COCO.

READ ALSO  Nigeria’s E-Waste Is A Public Health Problem, Requires Urgent Attention

“Another advantage of AN is that it facilitates better transfer learning between different domains,” Wu says. “For example, from image classification in ImageNet to object detection and semantic segmentation in MS-COCO. This is illustrated by the in the MS-COCO benchmark, which was obtained by fine-tuning ImageNet-pretrained deep neural networks in MS-COCO, a common workflow in state-of-the-art computer vision.

“We have released the and hope our AN will lead to better integrative design of .”

Source: techxplore

Total Views: 36 ,
0
0

Leave a Reply

Your email address will not be published. Required fields are marked *