Loughborough University
Browse

An adversarial contrastive learning based cross-modality zero-watermarking scheme for DIBR 3D video copyright protection

Download (2.89 MB)
journal contribution
posted on 2025-06-03, 14:18 authored by Xiyao Liu, Qingyu Dang, Huiyi Wang, Xiaoheng Deng, Xunli Fan, Cundian Yang, Zhihong Chen, Hui FangHui Fang

Copyright protection of depth image-based rendering (DIBR) videos has raised significant concerns due to their increasing popularity. Zero-watermarking, emerging as a powerful tool to protect the copyright of DIBR 3D videos, mainly relies on traditional feature extraction methods, thus necessitating improvements in robustness against complex geometric attacks and its ability to strike a balance between robustness and distinguishability. This paper presents a novel zero-watermarking scheme based on cross-modality feature fusion within a contrastive learning framework. Our approach integrates complementary information from 2D frames and depth maps using a cross-modality attention feature fusion mechanism to obtain discriminative features. Moreover, our features achieve a better trade-off between robustness and distinguishability by leveraging a designed contrastive learning strategy with an adversarial distortion simulator. Experimental results demonstrate our remarkable performance by reducing the false negative rates to around 0.2% when the false positive rate is equal to 0.5%, which is superior to the state-of-the-art zero-watermarking methods.


Funding

Natural Science Foundation of Hunan Province, China (2022GK5002, 2024JK2015, 2024JJ5440, 2023JJ30696)

Special Foundation for Distinguished Young Scientists of Changsha (kq2209003)

National Natural Science Foundation of China (61602527, 62172441, 62172449)

Joint Funds for Railway Fundamental Research of National Natural Science Foundation of China (U2368201)

Changsha Municipal Natural Science Foundation (kq2202109)

Special Fund of National Key Laboratory of Ni&Co Associated Minerals Resources Development and Comprehensive Utilization (GZSYS-KY-2022-018, GZSYS-KY-2022-024)

Key Project of Shenzhen City Special Fund for Fundamental Research (JCYJ20220818103200002, 202208183000751)

Foundation of State Key Laboratory of High Performance Computing, National University of Defense Technology (202401-13)

The High Performance Computing Center of Central South University

History

School

  • Science

Department

  • Computer Science

Published in

Neurocomputing

Volume

637

Publisher

Elsevier B.V.

Version

  • VoR (Version of Record)

Rights holder

©The Author(s)

Publisher statement

This is an open access article under the CC BY-NC-ND license ( http://creativecommons.org/licenses/by- nc-nd/4.0/ ).

Acceptance date

2025-03-16

Publication date

2025-03-25

Copyright date

2025

ISSN

0925-2312

eISSN

1872-8286

Language

  • en

Depositor

Dr Hui Fang. Deposit date: 16 March 2025

Article number

130068