Video Key Frame Extraction Method Combined with Tsallis Entropy and Jensen Distance

doi:10.3969/j.issn.1000-3428.2016.02.049

Abstract

Abstract: In order to summarize the main content of a video sequence quickly and effectively,this paper proposes a new method for extracting video key frames.The proposed technique makes use of Jensen-Tsallis distance to estimate the frame-by-frame distance between consecutive video images,to segment a video into shot,and into subshot either with or without large change of the video content.Video key frames are selected based on the subshot.It also proposes a measure for the difference between video frames to adaptively set an optimal index used for Tsallis entropy.Experimental result shows that the novel method is simple yet effective,and has better ability to identify the moving objects.

Key words: key frame extraction, Jensen-Tsallis distance, information entropy, entropy index, shot segmentation

摘要： 为快速有效地表征视频内容,提出一种视频关键帧抽取方法。结合Tsallis熵和Jensen距离计算相邻视频帧间差距,将视频分割为镜头,并根据镜头内视觉内容变化的多少将其分割为子镜头,最终抽取关键帧。同时提出视频帧间的距离度量标准,用于自适应地选取最优Tsallis 熵指数。实验测试结果表明,该方法简单高效,对物体运体有较好的鉴别能力。

关键词: 关键帧抽取, Jensen-Tsallis距离, 信息熵, 熵指数, 镜头分割

CLC Number:

TP18

LI Liangkai,XU Qing,LUO Xiaoxiao. Video Key Frame Extraction Method Combined with Tsallis Entropy and Jensen Distance[J]. Computer Engineering, doi: 10.3969/j.issn.1000-3428.2016.02.049.

李梁凯,徐庆,罗小小. 结合Tsallis熵与Jensen距离的视频关键帧抽取方法[J]. 计算机工程, doi: 10.3969/j.issn.1000-3428.2016.02.049.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.3969/j.issn.1000-3428.2016.02.049

http://www.ecice06.com/EN/Y2016/V42/I2/278

References

参考文献［1］Truong B T,Venkatesh S.Video Abstraction:A Systematic Review and Classification［J］.ACM Transactions on Multimedia Computing,Communications,and Applications,2007,3(1). ［2］Money A G,Agius H.Video Summarization:A Conceptual Framework and Survey of the State of the Art［J］.Journal of Visual Communication and Image Representation,2008,19(2):121-143. ［3］丁洪丽,陈怀新.基于镜头内容变化率的关键帧提取算法［J］.计算机工程,2009,35(13):225-227. ［4］Mentzelopoulos M,Psarrou A.Key-frame Extraction Algorithm Using Entropy Difference［C］//Proceedings of the 6th ACM SIGMM International Workshop on Multimedia Information Retrieval.New York,USA:ACM Press,2004:39-45. ［5］Cernekova Z,Pitas I,Nikou C.Information Theory-based Shot Cut/Fade Detection and Video Summariza-tion［J］.IEEE Transactions on Circuits and Systems for Video Technology,2006,16(1):82-91. ［6］Omidyeganeh M,Ghaemmaghami S,Shirmohammadi S.Video Keyframe Analysis Using a Segment-based Statistical Metric in a Visually Sensitive Parametric Space［J］.IEEE Transactions on Image Processing,2011,20(10):2730-2737. ［7］Janvier B,Bruno E,Pun T,et al.Information-theoretic Temporal Segmentation of Video and Applications:Multiscale Keyframes Selection and Shot Boundaries Detection［J］.Multimedia Tools and Applications,2006,30(3):273-288. ［8］He Yun,Hamza A B,Krim H.A Generalized Divergence Measure for Robust Image Registration［J］.IEEE Transactions on Signal Processing,2003,51(5):1211-1220. ［9］Xu Qing,Wang Pengcheng,Long Bin,et al.Selection and 3D Visualization of Video Key Frames［C］//Proceedings of IEEE International Conference on Systems Man and Cybernetics.Washington D.C.,USA:IEEE Press,2010:52-59. ［10］Lienhart R,Peiffer S,Effelsberg W.Video Abstrac-ting［J］.Communications of the ACM,1997,40(12):54-62. ［11］Harvda J,Charvát F.Quantification Method of Classi-fication Processes.Concept of Structural α-entropy［J］.Kybernetika,1967,3:30-35. ［12］Cover T M,Thomas J A.Elements of Information Theory［M］.［S.l.］:John Wiley & Sons,2012. ［13］Chang Hyun-sung,Sull S,Lee S U.Efficient Video Indexing Scheme for Content-based Retrieval［J］.IEEE Transactions on Circuits and Systems for Video Technology,1999,9(8):1269-1279. ［14］Liu Tiecheng,Kender J R.Computational Approaches to Temporal Sampling of Video Sequences［J］.ACM Transactions on Multimedia Computing Communications and Applications,2007,3(2):601-604. ［15］Liu Tianming,Zhang Hongjiang,Qi Feihu.A Novel Video Key-frame-extraction Algorithm Based on Perceived Motion Energy Model［J］.IEEE Transactions on Circuits and Systems for Video Technology,2003,13(10):1006-1013. 编辑顾逸斐

[1]	CHEN Hexiong, LUO Yuwei, WEI Yunkai, GUO Wei, HANG Feilu, HE Yingjun, YANG Ning. Collaborative Detection Technology of SDN Abnormal Traffic Based on Federated Learning [J]. Computer Engineering, 2023, 49(3): 168-176.
[2]	SUN Fulu, WANG Yujia, LIU Ziyi. Community Detection Algorithm Based on Node Gravity and Fish Memory [J]. Computer Engineering, 2022, 48(5): 104-111.
[3]	ZHU Yingbo, ZHAO Yangyang, WANG Pei, YIN Kai, WANG Zhenyu. Dialogue Strateqy Integrating Markov Decision Process and Information Entropy [J]. Computer Engineering, 2021, 47(3): 284-290.
[4]	WANG Xu, CHEN Yongle, WANG Qingsheng, CHEN Junjie. Cryptosystem Identification Scheme Combining Feature Selection and Ensemble Learning [J]. Computer Engineering, 2021, 47(1): 139-145,153.
[5]	ZHAO Jun, ZHU Sui, YANG Wenjing, XU Yanhui, PANG Yu. An Image Segmentation Algorithm Based on Density Peak Clustering [J]. Computer Engineering, 2020, 46(2): 274-278,285.
[6]	XUE Min,FANG Yong,HUANG Cheng,LIU Liang. Automatic Identification Method of API Key in Source Code [J]. Computer Engineering, 2018, 44(6): 117-121,129.
[7]	HUANG Yujie,TANG Zuoqi,LIANG Jing. Information Security Risk Assessment Based on Information Entropy and Three-parameter Interval [J]. Computer Engineering, 2018, 44(12): 178-183.
[8]	REN Zhuojun,CHEN Guang. Application of Entropy Visualization Method in Malware Classification [J]. Computer Engineering, 2017, 43(9): 167-171.
[9]	AN Jianrui,ZHANG Longbo,WANG Lei,JIN Chao,HUAI Hao,WANG Xiaodan. An Improved OPTICS Algorithm Based on Grid and Weighted Information Entropy [J]. Computer Engineering, 2017, 43(2): 206-209.
[10]	ZHENG En,LIN Jingyu. Disordered Image Key Frame Extraction Based on Image Quality Constraint [J]. Computer Engineering, 2017, 43(11): 210-215.
[11]	LIU Chao,HE Lijun,ZHU Guangyu. Solution of High Dimension Multi-objective Optimization Problem Based on Entropy and Membership Function [J]. Computer Engineering, 2016, 42(6): 185-190,195.
[12]	MA Ji,LIU Rui,ZHANG Jianxia. Key Frame Extraction for Human Motion Data Based on Improved t-SNE Algorithm [J]. Computer Engineering, 2016, 42(5): 258-262.
[13]	LIU Yanni,ZHANG Guicang,AN Jing. Double Histogram Equalization Image Enhancement Algorithm Based on Mathematical Morphology [J]. Computer Engineering, 2016, 42(1): 215-219.
[14]	ZHAO Xiao-bao, ZHANG Hua-ping. New Words Identification Based on Iterative Algorithm [J]. Computer Engineering, 2014, 40(7): 154-158,164.
[15]	WANG Na, WEI Bo, WANG Jin-dong, ZHANG Heng-wei. Cloud Service Selection Based on Chaotic Multi-objective Particle Swarm Optimization Algorithm [J]. Computer Engineering, 2014, 40(3): 23-27,38.

Please choose a citation manager

Content to export