Towards Enhancing Keyframe Extraction Strategy for Summarizing Surveillance Video: An Implementation Study
DOI:
https://doi.org/10.5614/itbj.ict.res.appl.2022.16.2.5Keywords:
keyframe extraction, surveillance video, video compression, video storage, video summarizationAbstract
The large amounts of surveillance video data are recorded, containing many redundant video frames, which makes video browsing and retrieval difficult, thus increasing bandwidth utilization, storage capacity, and time consumed. To ensure the reduction in bandwidth utilization and storage capacity to the barest minimum, keyframe extraction strategies have been developed. These strategies are implemented to extract unique keyframes whilst removing redundancies. Despite the achieved improvement in keyframe extraction processes, there still exist a significant number of redundant frames in summarized videos. With a view to addressing this issue, the current paper proposes an enhanced keyframe extraction strategy using k-means clustering and a statistical approach. Surveillance footage, movie clips, advertisements, and sports videos from a benchmark database as well as Compeng IP surveillance videos were used to evaluate the performance of the proposed method. In terms of compression ratio, the results showed that the proposed scheme outperformed existing schemes by 2.82%. This implies that the proposed scheme further removed redundant frames whiles retaining video quality. In terms of video playtime, there was an average reduction of 27.32%, thus making video content retrieval less cumbersome when compared with existing schemes. Implementation was done using MATLAB R2020b.
Downloads
References
Muhammad, B., Sadiq, B., Umoh, I. & Bello-Salau, H., A K-Means Clustering Approach for Extraction of Keyframes in Fast-Moving Videos, International Journal of Information Processing and Communication (IJIPC), 9(1&2), pp. 147-157, 2020.
Rodriguez, J.M.D., Yao, P. & Wan, W., Selection of Key Frames through the Analysis and Calculation of the Absolute Difference of Histograms. Paper presented at the 2018 International Conference on Audio, Language and Image Processing (ICALIP), 2018.
Kaur, P. & Kumar, R., Analysis of Video Summarization Techniques, International Journal for Research in Applied Science & Engineering Technology (IJRASET), 6(01), 2018.
Zedan, I.A., Elsayed, K.M. & Emary, E., News Videos Segmentation Using Dominant Colors Representation, Advances in Soft Computing and Machine Learning in Image Processing (pp. 89-109), Springer, 2018.
Zhang, Q., Yu, S.-P., Zhou, D.-S. & Wei, X.-P., An Efficient Method of Keyframe Extraction Based on a Cluster Algorithm, Journal of Human Kinetics, 39(1), pp. 5-14, 2013.
Del Fabro, M. & Bzmenyi, L., State-of-the-art and Future Challenges in Video Scene Detection: A Survey, Multimedia Systems, 19(5), pp. 427-454, 2013.
Li, X., Zhao, B. & Lu, X., Key Frame Extraction in the Summary Space. IEEE Transactions on Cybernetics, 48(6), pp. 1923-1934, 2017.
Paul, A., Milan, K., Kavitha, J., Rani, J. & Arockia, P.J., Key-Frame Extraction Techniques: A Review, Recent Patents on Computer Science. 11(1), pp. 3-16, 2018.
Asim, M., Almaadeed, N., Al-Mdeed, S., Bouridane, A. & Beghdadi, A. A Key Frame based Video Summarization Using Color Features. Paper presented at the 2018 Colour and Visual Computing Symposium (CVCS), Gjovik, Norway, pp. 1-6, 2018.
Santini, S., Who Needs Video Summarization Anyway? Paper presented at the International Conference on Semantic Computing (ICSC), Irvine, CA, USA, pp. 177-184, 2007.
Sheena, C.V. & Narayanan, N.J., Key-Frame Extraction by Analysis of Histograms of Video Frames Using Statistical Methods, Procedia Computer Science, 70, pp. 36-40, 2015.
Priya, G.L. & Domnic, S.J., Shot Boundary-Based Keyframe Extraction for Video Summarisation, International Journal of Computational Intelligence Studies. 3(2-3), pp. 157-175, 2014.
Yuan, J., Wang, H., Xiao, L., Zheng, W., Li, J. & Lin, F., A Formal Study of Shot Boundary Detection, IEEE transactions on circuits systems for video technology. 17(2), pp. 168-186, 2007.
Ejaz, N., Tariq & T. B., Baik, Adaptive Key Frame Extraction for Video Summarization Using an Aggregation Mechanism, Journal of Visual Communication Image Representation, 23(7), pp. 1031-1040, 2012.
Azhar, A.Z., Pramono, S. & & Supriyanto, E., An Analysis of Quality of Service (QoS) in Live Video Streaming Using Evolved HSPA Network Media, JAICT, 1(1), pp.1-6, 2016.
Kumar, K., Shrimankar, D.D. & Singh, N.J., Eratosthenes Sieve-Based Key-Frame Extraction Technique for Event Summarization in Videos. Multimedia Tools Applications, 77(6), pp. 7383-7404, 2018.
Gharbi, H., Bahroun, S. & Zagrouba, E., A Novel Key Frame Extraction Approach for Video Summarization, Paper presented at the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), Rome, Italy, pp. 148-155, 2016.
Sujatha, C. & Mudenagudi, U., A Study on Keyframe Extraction Methods for Video Summary. Paper presented at the 2011 International Conference on Computational Intelligence and Communication Networks, Gwalior, India, pp. 73-77, 2011.
Ali, I.H. & Al?Fatlawi, T.T., A Proposed Method for Key Frame Extraction, International Journal of Engineering Technology, 8(1.5), pp. 509-512, 2019.
Satpute, A.M. & Khandarkar, K.R., Video Summarization by Removing Duplicate Frames from Surveillance Video Using Keyframe Extraction, International Journal of Innovative Research in Computer and Communication Engineering, pp. 8501-8509, 2017. DOI:10.15680/IJIRCCE.2017. 050426.
Lv, C. & Huang, Y., Effective Keyframe Extraction from Personal Video by Using Nearest Neighbor Clustering. Paper presented at the 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Beijing, China, pp.1-4, 2018.
Sadiq, B.O, Muhammad, B, Abdullahi, M.N, Onuh, G., Ali, A.M. & Babatunde, A.E. Keyframe Extraction Techniques: A Review, Journal of Electrical Engineering (ELEKTRIKA), 19(3), pp. 54-60, 2020.
