Scene Segmentation for Interframe Forgery Identification
Keywords:inter-frame forgery, optical flow, similarity, static scene, scene segmentation, video forgery
A common type of video forgery is inter-frame forgery, which occurs in the temporal domain, such as frame duplication, frame insertion, and frame deletion. Some existing methods are not effective to detect forgeries in static scenes. This work proposes static and dynamic scene segmentation and performs forgery detection for each scene. Scene segmentation is performed for outlier detection based on changes of optical flow. Various similarity checks are performed to find the correlation for each frame. The experimental results showed that the proposed method is effective in identifying forgeries in various scenes, especially static scenes, compared with existing methods.
Fadl, S.M., Han, Q. & Li, Q., Authentication of Surveillance Videos: Detecting Frame Duplication Based on Residual Frame, Journal of forensic sciences, 63, pp. 1099-1109, 2018.
Yang, J., Huang, T. & Su, L., Using Similarity Analysis to Detect Frame Duplication Forgery in Videos, Multimedia Tools and Applications, 75, pp. 1793-1811, 2016.
Wang, W. & Farid, H., Exposing Digital Forgeries in Video by Detecting Duplication, In Proceedings of the 9th workshop on Multimedia & security, pp. 35-42, Sep. 2007.
Fadl, S.M., Han, Q. & Li, Q., Inter-Frame Forgery Detection Based on Differential Energy of Residue, IET Image Processing, 13, pp. 522-528, 2019.
Zheng, L., Sun, T. & Shi, Y.Q., Inter-Frame Video Forgery Detection Based on Block-wise Brightness Variance Descriptor, in Digital-Forensics and Watermarking: 13th International Workshop, IWDW 2014, Springer International Publishing, pp. 18-30, 2015.
Wang, W., Jiang, X., Wang, S., Wan, M. & Sun, T., Identifying Video Forgery Process Using Optical Flow, in Digital-Forensics and Watermarking: 12th International Workshop, IWDW 2013, Springer, pp. 244-257, 2014.
Fadl, S., Han, Q. & Qiong, L., Exposing Video Inter-Frame Forgery Via Histogram of Oriented Gradients and Motion Energy Image, in Multidimensional Systems and Signal Processing, 31, pp. 1365-1384, 2020.
Panchal, H.D. & Shah, H.B., Video Tampering Dataset Development in Temporal Domain for Video Forgery Authentication, Multimedia Tools and Applications, 79, pp. 24553-24577, 2020.
Grubbs, F.E., Sample Criteria for Testing Outlying Observations, The Annals of Mathematical Statistics, pp. 27-58, 1950.
Barron, J.L., Fleet, D.J. & Beauchemin, S.S., Performance of Optical Flow Techniques, International Journal of Computer Vision, 12, pp. 43-77, 1994.
Lucas, B.D. & Kanade, T., An Iterative Image Registration Technique with an Application to Stereo Vision, in IJCAI: 7th International Joint Conference on Artificial Intelligence, 81, pp. 674-679, 1981.