基于自注意力胶囊网络的伪造人脸检测方法

doi:10.19678/j.issn.1000-3428.0060267

计算机工程 ›› 2022, Vol. 48 ›› Issue (2): 194-200,206. doi: 10.19678/j.issn.1000-3428.0060267

基于自注意力胶囊网络的伪造人脸检测方法

李柯, 李邵梅, 吉立新, 刘硕

解放军战略支援部队信息工程大学信息技术研究所, 郑州 450003

收稿日期:2020-12-14 修回日期:2021-01-20 发布日期:2021-01-25
作者简介:李柯(1995-),男,硕士研究生,主研方向为图像处理、深度学习、计算机视觉;李邵梅,副教授;吉立新,研究员、博士生导师;刘硕,硕士研究生。
基金资助:
国家自然科学基金青年科学基金项目（62002384）。

Method of Face Forgery Detection Based on Self-Attention Capsule Network

LI Ke, LI Shaomei, JI Lixin, LIU Shuo

Institute of Information Technology, People's Liberation Army Strategic Support Force Information Engineering University, Zhengzhou 450003, China

Received:2020-12-14 Revised:2021-01-20 Published:2021-01-25

摘要/Abstract

摘要： 当前以换脸为代表的伪造视频泛滥，给国家、社会和个人带来潜在威胁，有效检测该类视频对保护个人隐私和维护国家安全具有重要意义。为提高视频伪造人脸检测效果，基于可解释性好的胶囊网络，以Capsule-Forensics检测算法为基础，提出一种结合自注意力胶囊网络的伪造人脸检测方法。使用部分Xception网络作为特征提取部分，降低模型的参数量，在主体部分引入带注意力机制的胶囊结构，使模型聚焦人脸区域，将综合多维度的Focal Loss作为损失函数，提高模型对难分样例的检测效果。实验结果表明，与Capsule-Forensics算法相比，该方法能够减少模型参数量和计算量，在多种伪造类型数据集上均具有较高的准确率。

关键词: 伪造人脸检测, 胶囊网络, 模型可视化, 注意力机制, 损失函数

Abstract: In recent years, face forgery is abused in fake videos, imposing a potential threat on the national, social and individual level, so face forgery detection is of great significance to individual privacy protection and national security.To improve the performance of face forgery detection for fake videos, a face forgery detection method that combines a self-attention capsule network with the Capsule-Forensics algorithm is proposed.This method uses part of the Xception network for feature extraction, which reduces the number of parameters.Then a capsule structure with attention mechanism is introduced into the main part to make the model focus on the facial area.Finally, the comprehensive multi-dimensional Focal Loss is used as the loss function to improve the detection effect of the model for indistinguishable samples.Experimental results show that compared with the Capsule-Forensics algorithm, this method can reduce the number of model parameters and the amount of computation, while displaying a higher accuracy on multiple forgery data sets.

Key words: face forgery detection, capsule network, model visualization, attention mechanism, loss function

中图分类号:

TP391.41

李柯, 李邵梅, 吉立新, 刘硕. 基于自注意力胶囊网络的伪造人脸检测方法[J]. 计算机工程, 2022, 48(2): 194-200,206.

LI Ke, LI Shaomei, JI Lixin, LIU Shuo. Method of Face Forgery Detection Based on Self-Attention Capsule Network[J]. Computer Engineering, 2022, 48(2): 194-200,206.

http://www.ecice06.com/CN/Y2022/V48/I2/194

图/表 11

20220301124151

20220301124155

20220301124159

20220301124203

20220301124208

20220301124213

20220301124217

20220301124221

20220301124225

20220301124229

20220301124233

参考文献

[1] THIES J, ZOLLHOFER M, STAMMINGER M, et al.Face2Face:real-time face capture and reenactment of RGB videos[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2016:2387-2395.
[2] THIES J, ZOLLHOFER M, NIEßNER M.Deferred neural rendering:image synthesis using neural textures[J].ACM Transactions on Graphics, 2019, 38(4):1-12.
[3] GUERA D, DELP E J.DeepFake video detection using recurrent neural networks[C]//Proceedings of the 15th IEEE International Conference on Advanced Video and Signal Based Surveillance.Washington D.C., USA:IEEE Press, 2018:1-6.
[4] 张怡暄, 李根, 曹纭, 等.基于帧间差异的人脸篡改视频检测方法[J].信息安全学报, 2020, 5(2):49-72. ZHANG Y X, LI G, CAO Y, et al.A method for detecting human-face-tampered videos based on Interframe difference[J].Journal of Cyber Security, 2020, 5(2):49-72.(in Chinese)
[5] LI Y, LYU S.Exposing deepfake videos by detecting face warping artifacts[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2019:46-52.
[6] MATERN F, RIESS C, STAMMINGER M.Exploiting visual artifacts to expose deep fakes and face manipulations[C]//Proceedings of 2019 IEEE Winter Applications of Computer Vision Workshops.Washington D.C., USA:IEEE Press, 2019:83-92.
[7] YANG X, LI Y Z, LYU S, Exposing deep fakes using inconsistent head poses[EB/OL].[2020-11-10].https://arxiv.org/pdf/1811.00656v3.pdf.
[8] TARIQ S, LEE S, KIM H, et al.Detecting both machine and human created fake face images in the wild[C]//Proceedings of the 2nd International Workshop on Multimedia Privacy and Security.Vancouver, Canada:CCS Press, 2018:81-87.
[9] SABOUR S, FROSST N, HINTON G E.Dynamic routing between capsules[EB/OL].[2020-11-10].https://arxiv.org/abs/1710.09829v1.
[10] LALONDE R, BAGCI U.Capsules for object segmentation[EB/OL].[2020-11-10].https://arxiv.org/pdf/1804.04241.pdf.
[11] IESMANTAS T, ALZBUTAS R.Convolutional capsule network for classification of breast cancer histology images[C]//Proceedings of International Conference on Image Analysis and Recognition.Berlin, German:Springer, 2018:853-860.
[12] NGUYEN H H, YAMAGISHI J, ECHIZEN I.Capsule-forensics:using capsule networks to detect forged images and videos[C]//Proceedings of IEEE International Conference on Acoustics.London, UK:IEEE Press, 2019:2307-2311.
[13] CHOLLET F.Xception:deep learning with depthwise separable convolutions[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2017:1800-1807.
[14] ROSSLER A, COZZOLINO D, VERDOLIVA L, et al.FaceForensics++:learning to detect manipulated facial images[EB/OL].[2020-11-10].https://arxiv.org/pdf/1901.08971.pdf.
[15] BONETTINI N, DANIELE E, MANDELLI S, et al.Video face manipulation detection through ensemble of CNNs[EB/OL].[2020-11-10].https://arxiv.org/pdf/2004.07676.pdf.
[16] WANG X L, GIRSHICK R, GUPTA A, et al.Non-local neural networks[EB/OL].[2020-11-10].https://arxiv.org/pdf/1711.07971v3.pdf.
[17] LIN T Y, GOYAL P, GIRSHICK R, et al.Focal loss for dense object detection[C]//Proceedings of 2017 IEEE International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2017:2999-3007.
[18] DENG J K, GUO J, ZHOU Y X, et al, RetinaFace:single-stage dense face localisation in the wild[C]//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2020:5202-5211.
[19] AFCHAR D, NOZICK V, YAMAGISHI J, et al.MesoNet:a compact facial video forgery detection network[C]//Proceedings of 2018 IEEE International Workshop on Information Forensics and Security.Washington D.C., USA:IEEE Press, 2018:1-7.
[20] TAN M, QUOC V.EfficientNet:rethinking model scaling for convolutional neural networks[C]//Proceedings of International Conference on Machine Learning.New York, USA:ACM Press, 2019:6105-6114.
[21] SELVARAJU R R, COGSWELL M, DAS A, et al.Grad-CAM:visual explanations from deep networks via gradient-based localization[J].International Journal of Computer Vision, 2020, 128(2):336-359.
[22] MAATEN L V D.Accelerating T-SNE using tree-based algorithms[J].Journal of Machine Learning Research, 2014, 15(1):3221-3245.

选择文件类型/文献管理软件名称

选择包含的内容

基于自注意力胶囊网络的伪造人脸检测方法

Method of Face Forgery Detection Based on Self-Attention Capsule Network

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 11

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	丰芳宇, 罗晓曙, 蒙志明, 王广宇. 基于抗混叠残差注意力网络的人脸表情识别[J]. 计算机工程, 2023, 49(8): 190-198.
[2]	王书朋, 何引弟. 融合特征注意力机制的非均匀光照图像增强算法[J]. 计算机工程, 2023, 49(8): 232-239.
[3]	刘昊鑫, 董超, 勾智楠, 高凯. 融合混合表征的小样本关系抽取方法[J]. 计算机工程, 2023, 49(8): 63-68.
[4]	杨长沛, 廖列法. 基于门控空洞卷积特征融合的中文命名实体识别[J]. 计算机工程, 2023, 49(8): 85-95.
[5]	刘俊豪, 王美林, 谢兴, 宋烨兴, 许莉花. 基于改进YOLOv5的皮革瑕疵检测算法[J]. 计算机工程, 2023, 49(8): 240-249.
[6]	马娜, 温廷新, 贾旭, 李晓会. 复杂光照条件下自适应的车脸重识别模型[J]. 计算机工程, 2023, 49(8): 275-282, 290.
[7]	陈露萌, 曹彦彦, 黄民, 谢鑫钢. 基于改进YOLOv5的火焰检测方法[J]. 计算机工程, 2023, 49(8): 291-301, 309.
[8]	李强龙, 周新文, 位梦恩, 甘阳洲. 基于条形池化和注意力机制的街道场景红外目标检测算法[J]. 计算机工程, 2023, 49(8): 310-320.
[9]	张家熔, 苑津莎, 许珈宁, 罗志宏. 基于多元信息嵌入与协同神经网络的力学实体识别算法[J]. 计算机工程, 2023, 49(7): 125-134.
[10]	白明昌. 基于折叠路径聚合的属性网络节点嵌入方法[J]. 计算机工程, 2023, 49(7): 76-84.
[11]	费蓉, 马梦阳, 张晓, 黑新宏, 徐庆征, 邱原. 基于轨迹预测与冲突检测的自动驾驶碰撞检测模型[J]. 计算机工程, 2023, 49(7): 10-20.
[12]	刘豪, 吴红兰, 房宇轩. 结合全局上下文信息的高效人体姿态估计[J]. 计算机工程, 2023, 49(7): 102-109.
[13]	吴珊, 周凤. 基于改进SSD算法的小目标检测[J]. 计算机工程, 2023, 49(7): 179-188.
[14]	齐咏生, 杜晓旭, 朱俊峰, 高胜利, 刘利强. 基于增强型轻量深度网络的牧区牲畜高效检测[J]. 计算机工程, 2023, 49(7): 278-287.
[15]	陈明, 刘蓉, 张晔. 基于多重注意力机制的中文医疗实体识别[J]. 计算机工程, 2023, 49(6): 314-320.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

基于自注意力胶囊网络的伪造人脸检测方法

Method of Face Forgery Detection Based on Self-Attention Capsule Network

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 11

参考文献

相关文章 15

编辑推荐

Metrics

本文评价