Abstract:

Cross-entropy is a common loss function used in classification tasks. However, existing deep classification methods often use the cross-entropy design of a single model, which leads to problems such as low generalization ability and poor robustness. Based on multi-representation learning, this study proposes a deep cross-entropy ensemble loss function to improve the generalization ability and robustness of deep networks. The proposed method learns the different representations of multiple depth perspectives under the same image data samples by constructing diversified sub-networks and finally classifies the multi-perspective representations of image data using a cross-entropy ensemble loss design. The method fully utilizes the diversified representations of multi-view deep networks for robust image classification. This means that the proposed cross-entropy losses from multiple views can be unified into an overall ensemble space for classification, thereby improving the image classification capabilities under the traditional single cross-entropy design. Experimental results on multiple image datasets such as SVHN and CIFAR show that the proposed method significantly improves the recognition accuracy compared with existing image classification methods such as MEAL and CEN.

Key words: deep network, image classification, cross-entropy loss, multi-representation learning, ensemble learning

摘要：

交叉熵损失是分类任务中常见的损失函数, 然而现有深度分类方法往往使用单模型的交叉熵设计, 存在分类泛化能力低、鲁棒性差等问题。受到多视图表征学习的启发, 提出一种深度集成的交叉熵损失方法, 以提高模型的泛化能力和鲁棒性。通过构建多样化子网络, 学习单一图像数据下多个深度视角的不同表征, 最终通过集成化交叉熵设计, 将图像数据的多视角表征进行集成分类。该方法可以充分利用多视角深度网络的多样化表征进行图像的鲁棒分类, 即将多个视图的交叉熵损失统一到整体的集成空间中进行分类, 从而提升传统单一模型交叉熵设计下的图像分类性能。在SVHN、CIFAR等图像数据集上的实验结果表明, 相比于现有的MEAL、CEN等图像分类方法, 该方法在识别准确率上获得了明显提升。

关键词: 深层网络, 图像分类, 交叉熵损失, 多表征学习, 集成学习