No-Reference Video Quality Assessment based on The Dover Framework using A Transfer Learning Method
DOI:
https://doi.org/10.31961/eltikom.v9i1.1398Keywords:
accuracy, DOVER, efficiency, machine learning, transfer learningAbstract
No-reference Video Quality Assessment (VQA) presents a critical challenge in digital multimedia. This study explores video quality measurement using the DOVER framework combined with a transfer learning method. While existing approaches often rely on end-to-end fine-tuning that requires substantial computational resources, this study introduces and validates a more efficient implementation. The model was built using Google Colab and Python, with the KoNViD-1k dataset as the training base. A head-only transfer learning approach was employed, using the DOVER framework as its foundation. This approach addresses a key research gap in resource-efficient no-reference VQA, as many state-of-the-art models remain impractical for real-world deployment due to high computational demands. The training process was conducted over 10 epochs with resource efficiency in mind. The head-only transfer learning technique allows for GPU memory optimization, showing minimal accuracy differences (1%–2%) compared to full end-to-end fine-tuning. Unlike previous studies that compromise performance for efficiency, this approach maintains competitive accuracy while significantly lowering computational costs. The results show that the proposed method delivers accurate and efficient video quality assessments, confirming the potential of the DOVER framework in no-reference VQA. This study highlights a practical balance between computational efficiency and assessment accuracy using transfer learning techniques.
Downloads
References
M. L. B. dos Santos, “The ‘so-called’ UGC: an updated definition of user-generated content in the age of social media,” Online Infor-mation Review, vol. 46, no. 1, pp. 95–113, 2022.
H. Wu et al., “Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectives,” in Inter-national Conference on Computer Vision (ICCV), 2023.
F. Fan, C. Luo, W. Gao, and J. Zhan, “AIGCBench: Comprehensive Evaluation of Image-to-Video Content Generated by AI.” 2024. [Online]. Available: https://arxiv.org/abs/2401.01651
B. Qu, X. Liang, S. Sun, and W. Gao, “Exploring AIGC Video Quality: A Focus on Visual Harmony, Video-Text Consistency and Do-main Distribution Gap.” 2024. [Online]. Available: https://arxiv.org/abs/2404.13573
H. Wu et al., “FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Sampling,” in Proceedings of European Conference of Computer Vision (ECCV), 2022.
M. Iman, H. R. Arabnia, and K. Rasheed, “A Review of Deep Transfer Learning and Recent Advancements,” Technologies, vol. 11, no. 2, 2023, doi: 10.3390/technologies11020040.
U. Evci, V. Dumoulin, H. Larochelle, and M. C. Mozer, “Head2toe: Utilizing intermediate representations for better transfer learning,” in International Conference on Machine Learning, PMLR, 2022, pp. 6009–6033.
H. Wu, “Open Source Deep End-to-End Video Quality Assessment Toolbox.” 2022. [Online]. Available: http://github.com/timothyhtimothy/fast-vqa
V. Hosu et al., “The Konstanz natural video database (KoNViD-1k),” in 2017 Ninth International Conference on Quality of Multime-dia Experience (QoMEX), 2017, pp. 1–6. doi: 10.1109/QoMEX.2017.7965673.
M. Canesche, L. Bragança, O. P. V. Neto, J. A. Nacif, and R. Ferreira, “Google Colab CAD4U: Hands-On Cloud Laboratories for Digi-tal Design,” in 2021 IEEE International Symposium on Circuits and Systems (ISCAS), 2021, pp. 1–5. doi: 10.1109/ISCAS51556.2021.9401151.
A. Rawat, “A Review on Python Programming,” International Journal of Research in Engineering, Science and Management, vol. 3, no. 12, pp. 8–11, Dec. 2020.
O. Keleş, M. A. Yιlmaz, A. M. Tekalp, C. Korkmaz, and Z. Doğan, “On the Computation of PSNR for a Set of Images or Video,” in 2021 Picture Coding Symposium (PCS), 2021, pp. 1–5. doi: 10.1109/PCS50896.2021.9477470.
I. Bakurov, M. Buzzelli, R. Schettini, M. Castelli, and L. Vanneschi, “Structural similarity index (SSIM) revisited: A data-driven ap-proach,” Expert Systems with Applications, vol. 189, p. 116087, 2022, doi: https://doi.org/10.1016/j.eswa.2021.116087.
X. Min, H. Duan, W. Sun, Y. Zhu, and G. Zhai, “Perceptual video quality assessment: a survey,” Science China Information Sciences, vol. 67, no. 11, p. 211301, Oct. 2024, doi: 10.1007/s11432-024-4133-3.
B. Chen, L. Zhu, G. Li, F. Lu, H. Fan, and S. Wang, “Learning Generalized Spatial-Temporal Deep Feature Representation for No-Reference Video Quality Assessment,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 4, pp. 1903–1916, 2022, doi: 10.1109/TCSVT.2021.3088505.
S. Dost, F. Saud, M. Shabbir, M. G. Khan, M. Shahid, and B. Lovstrom, “Reduced reference image and video quality assessments: review of methods,” EURASIP Journal on Image and Video Processing, vol. 2022, no. 1, p. 1, Jan. 2022, doi: 10.1186/s13640-021-00578-y.
D. Li, T. Jiang, and M. Jiang, “Unified Quality Assessment of in-the-Wild Videos with Mixed Datasets Training,” International Journal of Computer Vision, vol. 129, no. 4, pp. 1238–1257, Apr. 2021, doi: 10.1007/s11263-020-01408-w.
NVIDIA Corporation, “NVIDIA T4 Tensor Core GPU.” [Online]. Available: https://www.nvidia.com/en-us/data-center/tesla-t4/
M. Iman, H. R. Arabnia, and R. M. Branchinst, “Pathways to Artificial General Intelligence: A Brief Overview of Developments and Ethical Issues via Artificial Intelligence, Machine Learning, Deep Learning, and Data Science,” in Advances in Artificial Intelligence and Applied Cognitive Computing, H. R. Arabnia, K. Ferens, D. De La Fuente, E. B. Kozerenko, J. A. Olivas Varela, and F. G. Tinetti, Eds., in Transactions on Computational Science and Computational Intelligence, Cham: Springer International Publishing, 2021, pp. 73–87. doi: 10.1007/978-3-030-70296-0_6.
A. Antsiferova, S. Lavrushkin, M. Smirnov, A. Gushchin, D. Vatolin, and D. Kulikov, “Video compression dataset and benchmark of learning-based video-quality metrics,” in Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, Eds., Curran Associates, Inc., 2022, pp. 13814–13825. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2022/file/59ac9f01ea2f701310f3d42037546e4a-Paper-Datasets_and_Benchmarks.pdf
E. Pizzi et al., “The 2023 video similarity dataset and challenge,” Computer Vision and Image Understanding, vol. 243, p. 103997, 2024, doi: https://doi.org/10.1016/j.cviu.2024.103997.
Z. Zhang et al., “MD-VQA: Multi-dimensional quality assessment for UGC live videos,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 1746–1755.
K. Bouraqia, E. Sabir, M. Sadik, and L. Ladid, “Quality of Experience for Streaming Services: Measurements, Challenges and In-sights,” IEEE Access, vol. 8, pp. 13341–13361, 2020, doi: 10.1109/ACCESS.2020.2965099.
G. Margetis, G. Tsagkatakis, S. Stamou, and C. Stephanidis, “Integrating Visual and Network Data with Deep Learning for Streaming Video Quality Assessment,” Sensors, vol. 23, no. 8, p. 3998, Apr. 2023, doi: 10.3390/s23083998.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Ardhi Muda Ariska, Tubagus Maulana Kusuma
This work is licensed under a Creative Commons Attribution 4.0 International License.
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
