Loughborough University
Browse

Towards compact reversible image representations for neural style transfer

conference contribution
posted on 2024-07-25, 14:21 authored by Xiyao Liu, Siyu Yang, Jian Zhang, Gerald SchaeferGerald Schaefer, Jiya Li, Xunli Fan, Songtao Wu, Hui FangHui Fang

Arbitrary neural style transfer aims to stylise a content image by referencing a provided style image. Despite various efforts to achieve both content preservation and style transferability, learning effective representations for this task remains challenging since the redundancy of content and style features leads to unpleasant image artefacts. In this paper, we learn compact neural representations for style transfer motivated from an information theoretical perspective. In particular, we enforce compressive representations across sequential modules of a reversible flow network in order to reduce feature redundancy without losing content preservation capability. We use a Barlow twins loss to reduce channel dependency and thus to provide better content expressiveness, and optimise the Jensen-Shannon divergence of style representations between reference and target images to avoid under- and over-stylisation. We demonstrate the effectiveness of our proposed method in comparison to other state-of-the-art style transfer methods.

History

School

  • Science

Department

  • Computer Science

Source

The 18th European Conference on Computer Vision ECCV 2024

Publisher

Springer

Version

  • AM (Accepted Manuscript)

Publisher statement

This version of the contribution has been accepted for publication, after peer review (when applicable) but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/xxxxx. Use of this Accepted Version is subject to the publisher’s Accepted Manuscript terms of use https://www.springernature.com/gp/open-research/policies/accepted-manuscript-terms

Acceptance date

2024-07-01

Publisher version

Language

  • en

Location

Milano, Italy

Event dates

29th September 2024 - 4th October 2024

Depositor

Dr Hui Fang. Deposit date: 1 July 2024

Usage metrics

    Loughborough Publications

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC