Joint structure-texture low dimensional modeling for image decomposition with a plug and play framework - ANR - Agence nationale de la recherche Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2024

Joint structure-texture low dimensional modeling for image decomposition with a plug and play framework

Antoine Guennec
  • Fonction : Auteur
  • PersonId : 1402082
Jean-François Aujol
Yann Traonmilin
  • Fonction : Auteur
  • PersonId : 1077290

Résumé

To address the problem of separating images into a structure and a texture component, we introduce a joint structure-texture model. Instead of considering two separate regularizations for each component, we consider a joint structure-texture model regularization function that takes both components as inputs. This allows for the regularization to take into account the shared information between the two components. We present evidence that shows a performance gain compared to separate regularization models. To implement the joint regularization, we adapt the plug and play framework to our setting, using deep neural networks. We train the corresponding deep prior on a randomly generated synthetic dataset of examples of this model. In the context of image decomposition, we show that while trained on synthetic datasets, our plug and play method generalizes well to natural images. Furthermore, we show that this framework permits to leverage the structure-texture decompositions to solve inverse imaging problems such as inpainting.
Fichier principal
Vignette du fichier
article_pnp_siam.pdf (3.74 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
Domaine public

Dates et versions

hal-04648963 , version 1 (15-07-2024)

Licence

Domaine public

Identifiants

  • HAL Id : hal-04648963 , version 1

Citer

Antoine Guennec, Jean-François Aujol, Yann Traonmilin. Joint structure-texture low dimensional modeling for image decomposition with a plug and play framework. 2024. ⟨hal-04648963⟩
0 Consultations
0 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More