This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Unifying Color and Texture Transfer for Predictive Appearance Manipulation

F. Okura and K. Vanhoey and A. Bousseau and A. Efros and G. Drettakis
Computer Graphics Forum
Vol. 34, No. 4, pp. 53 - 63, 2015


Recent color transfer methods use local information to learn the transformation from a source to an exemplar image, and then transfer this appearance change to a target image. These solutions achieve very successful results for general mood changes, e.g., changing the appearance of an image from ''sunny'' to ''overcast''. However, such methods have a hard time creating new image content, such as leaves on a bare tree. Texture transfer, on the other hand, can synthesize such content but tends to destroy image structure. We propose the first algorithm that unifies color and texture transfer, outperforming both by leveraging their respective strengths. A key novelty in our approach resides in teasing apart appearance changes that can be modeled simply as changes in color versus those that require new image content to be generated. Our method starts with an analysis phase which evaluates the success of color transfer by comparing the exemplar with the source. This analysis then drives a selective, iterative texture transfer algorithm that simultaneously predicts the success of color transfer on the target and synthesizes new content where needed. We demonstrate our unified algorithm by transferring large temporal changes between photographs, such as change of season - e.g., leaves on bare trees or piles of snow on a street - and flooding.

Link to publisher's page
  author = {F. Okura and K. Vanhoey and A. Bousseau and A. Efros and G. Drettakis},
  title = {Unifying Color and Texture Transfer for Predictive Appearance Manipulation},
  journal = {Computer Graphics Forum},
  year = {2015},
  month = {},
  pages = {53 - 63},
  volume = {34},
  number = {4},
  keywords = {}