Community hub
0 subscribers8 pages, 0 posts
Recent from talks
Be the first to start a discussion here.
Be the first to start a discussion here.
Be the first to start a discussion here.
Be the first to start a discussion here.
Contribute something
Welcome to the community hub built to collect knowledge and have discussions related to Image color transfer.
Nothing was collected or created yet.
Image color transfer
View on Wikipediafrom Wikipedia
Color mapping example
Source image
Reference image
Source image color mapped using histogram matching
Image color transfer is a function that maps (transforms) the colors of one (source) image to the colors of another (target) image. A color mapping may be referred to as the algorithm that results in the mapping function or the algorithm that transforms the image colors. The image modification process is sometimes called color transfer or, when grayscale images are involved, brightness transfer function (BTF); it may also be called photometric camera calibration or radiometric camera calibration.
The term image color transfer is a bit of a misnomer since most common algorithms transfer both color and shading. (Indeed, the example shown on this page predominantly transfers shading other than a small orange region within the image that is adjusted to yellow.)
Algorithms
[edit]There are two types of image color transfer algorithms: those that employ the statistics of the colors of two images, and those that rely on a given pixel correspondence between the images. In a wide-ranging review, Faridul and others [1] identify a third broad category of implementation, namely user-assisted methods.
An example of an algorithm that employs the statistical properties of the images is histogram matching. This is a classic algorithm for color transfer, but it can suffer from the problem that it is too precise so that it copies very particular color quirks from the target image, rather than the general color characteristics, giving rise to color artifacts. Newer statistic-based algorithms deal with this problem. An example of such algorithm is one that adjusts the mean and the standard deviation of each of the source image channels to match those of the corresponding reference image channels. This adjustment process is typically performed in the Lαβ or Lab color spaces.[2]
A common algorithm for computing the color mapping when the pixel correspondence is given is building the joint-histogram (see also co-occurrence matrix) of the two images and finding the mapping by using dynamic programming based on the joint-histogram values.[3]
When the pixel correspondence is not given and the image contents are different (due to different point of view), the statistics of the image corresponding regions can be used as an input to statistics-based algorithms, such as histogram matching. The corresponding regions can be found by detecting the corresponding features.[4]
Liu[5] provides a review of image color transfer methods. The review extends into considerations of video color transfer and deep learning methods including Neural style transfer.
Applications
[edit]Color transfer processing can serve two different purposes: one is calibrating the colors of two cameras for further processing using two or more sample images, the second is adjusting the colors of two images for perceptual visual compatibility.
Color calibration is an important pre-processing task in computer vision applications. Many applications simultaneously process two or more images and, therefore, need their colors to be calibrated. Examples of such applications are: Image differencing, registration, object recognition, multi-camera tracking, co-segmentation and stereo reconstruction.
Other applications of image color transfer have been suggested. These include the co-option of color palettes from recognised sources such as famous paintings and the use as a further alternative to color modification methods commonly found in commercial image processing applications such as ‘posterise’, ‘solarise’ and ‘gradient’.[6] A web application has been made available to explore these possibilities.
Nomenclature
[edit]The use of the terms source and target in this article reflects the usage in the seminal paper by Reinhard et al.[2] However, others such as Xiao and Ma[7] reverse that usage and indeed it seems more natural to consider that the colors from a source image are directed at a target image. Adobe use the term source for the color reference image in the Photoshop Match Color function. Because of confusion over this terminology some software has been released into the public domain with incorrect functionality.[8] To minimise further confusion, it may be good practice henceforth to utilise terms such as input image or base image and color source image or color palette image respectively.
See also
[edit]References
[edit]- ^ Faridul, H. Sheikh; Pouli, T.; Chamaret, C.; Stauder, J.; Reinhard, E.; Kuzovkin, D.; Tremeau, A. (February 2016). "Colour Mapping: A Review of Recent Methods, Extensions and Applications: Colour Mapping". Computer Graphics Forum. 35 (1): 59–88. doi:10.1111/cgf.12671. S2CID 13038481. Retrieved 9 June 2023.
- ^ a b Color Transfer between Images
- ^ Inter-Camera Color Calibration using Cross-Correlation Model Function
- ^ Piecewise-consistent Color Mappings of Images Acquired Under Various Conditions Archived 2011-07-21 at the Wayback Machine
- ^ Liu, Shiguang (2022). "An Overview of Color Transfer and Style Transfer for Images and Videos". arXiv:2204.13339 [cs.CV].
- ^ Johnson, Terry (28 May 2022). "A Free-toUse Web App for Image Colour Transfer Processing". Medium.
- ^ Xioa, X; Ma, L (2006). "Color transfer in correlated color space". Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications. pp. 305–309. doi:10.1145/1128923.1128974. ISBN 1-59593-324-7.
- ^ "source and target reverse · Issue #11 · jrosebr1/color_transfer". GitHub. Retrieved 16 May 2025.
Color topics | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Color science |
|  | ||||||||
| Color philosophy |
| |||||||||
| Color terms |
| |||||||||
| Color organizations | ||||||||||
| Names |
| |||||||||
| Related | ||||||||||
Image color transfer
View on Grokipediafrom Grokipedia
Image color transfer is a technique in computer graphics and image processing that modifies the color palette of a source image to emulate the color characteristics of a target image, thereby changing its visual mood or style while preserving the underlying content and structure.[1] This process typically involves analyzing statistical properties such as means and standard deviations in a decorrelated color space, like lαβ, to map colors from the target to the source without introducing cross-channel artifacts.
The concept gained prominence with the seminal work by Reinhard et al. in 2001, which introduced an automated method using principal component analysis in the lαβ color space—derived from human vision models—to achieve coherent color adjustments, applicable to scenarios ranging from subtle corrections to dramatic stylistic shifts, such as rendering a daytime scene at sunset.[2] Early approaches were predominantly statistical, focusing on global histogram matching or mean-variance transfers, but faced limitations in handling local variations or complex illuminations.[1]
Subsequent developments incorporated user-guided interactions, such as stroke-based editing to specify regions for transfer, enhancing control over selective color application.[1] The advent of deep learning in the 2010s revolutionized the field, with methods like neural style transfer by Gatys et al. (2016) leveraging convolutional neural networks to capture and apply both color and textural styles semantically.[3] As of 2024, advances including example-guided transfers addressing emotional or illumination-specific adaptations—now extended by diffusion models and transformers—have broadened applications to video harmonization, underwater image correction, and artistic rendering, making color transfer integral to tools in digital photography, film post-production, and computer vision.[4]
This procedure is applied independently to each channel after space conversion, followed by inverse transformation to RGB; progressive variants downsample histograms across scales to capture multi-level features like peaks and valleys for more creative control.[17]
Overview
Definition
Image color transfer is a computer vision technique that applies a transformation to adjust the color distribution of a source image so that it matches the color characteristics of a reference target image, while preserving the underlying spatial structure and content of the source.[1] This process involves mapping the pixels' color values from the source to align with the target's palette, enabling the creation of visually consistent or stylistically altered images without changing the geometric layout or details. Unlike style transfer, which incorporates broader artistic elements such as textures, patterns, and brush strokes from a reference, color transfer focuses exclusively on hue, saturation, and brightness adjustments to replicate color mood or ambiance.[1] It also differs from traditional color correction, which primarily addresses technical inaccuracies like exposure or white balance for perceptual neutrality across devices, whereas color transfer is intentionally creative and reference-driven. The basic workflow begins with selecting a source image for its content and a target image for its desired color scheme, followed by applying a color mapping function at the pixel level, typically in a decorrelated color space such as lαβ or LAB, to generate the output image.[1][2] For instance, applying the warm, orange-dominated tones of a sunset photograph to a cityscape can produce an urban scene that evokes a nostalgic effect. This pixel-wise manipulation relies on statistical analysis of color distributions, such as simple histogram matching, to ensure the transfer maintains structural integrity.[1]History
The development of image color transfer techniques emerged from early efforts in digital image processing during the 1990s, where color correction in computer graphics and photography relied on manual adjustments and basic statistical methods like histogram matching to align color distributions between images. These approaches, often implemented in early digital editing software, addressed issues such as illumination inconsistencies but required significant user intervention and lacked automation for complex palette transfers.[1] A pivotal advancement occurred in 2001 with the seminal work by Reinhard et al., which introduced an automated statistical method for color transfer by matching the mean and standard deviation of pixel colors in the perceptually uniform lαβ color space, enabling one image to adopt the overall color characteristics of another without manual tuning. This global transfer technique laid the foundation for subsequent research by demonstrating effective example-based recoloring for natural scenes. Building on this in the 2000s, methods evolved to handle multi-image and sequential transfers; for instance, Morovic and Sun in 2003 proposed optimal transport formulations to better align color distributions across multiple sources, while Pitié et al. in 2005 extended this with probability density function transfers for automated color grading in images and videos. Further extensions included 3D color space mappings for enhanced fidelity, as explored in works like Ferradans et al.'s contributions to relaxed optimal transport in the early 2010s, though initial 3D explorations appeared around 2003 in histogram transformations.[2][5][6][7] The 2010s saw a shift toward local and advanced transfers to account for non-uniform illumination and spatial variations, with Pitié et al.'s 2007 optimal transport methods adapted for multi-step mappings that preserved local details, and later works like An et al. in 2010 incorporating user-controllable edits for targeted regions. This period emphasized robustness in diverse scenarios, such as sequence consistency. Post-2015, deep learning revolutionized the field through integration with convolutional neural networks (CNNs); Gatys et al.'s 2016 neural style transfer algorithm, using feature correlations from pre-trained CNNs, was adapted for pure color palette imposition while preserving content structure.[6][1] In the 2020s, trends have focused on real-time video color transfer and AI-driven methods leveraging generative adversarial networks (GANs) for dynamic, high-fidelity adaptations, including color-style separation to isolate chromatic elements from textures. Surveys highlight GAN-based approaches, such as those using CycleGAN variants for unpaired image transfers, enabling efficient video grading with temporal coherence. Recent works, such as ModFlows (2025) using rectified flows for color transfer and integrations in commercial software like Luminar Neo (2024), continue to emphasize efficiency, user accessibility, and perceptual realism as of November 2025. These advancements support applications in media production, with ongoing research emphasizing scalability.[1][8][9][10]Fundamentals
Color Spaces
Image color transfer relies on appropriate representations of color to ensure accurate mapping between source and target images. Common color spaces include RGB, which is an additive model used in digital displays where red, green, and blue channels combine to produce a wide gamut of colors, but it is device-dependent and exhibits strong correlations between channels. In contrast, CMYK is a subtractive color space employed in printing, utilizing cyan, magenta, yellow, and black inks to absorb light and reproduce colors on physical media, making it suitable for output but less common in digital image transfer due to its focus on ink limitations.[11] The CIE Lab* (Lab) space, defined in 1976, is perceptually uniform, separating lightness (L*) from color opponents (a* for red-green, b* for yellow-blue), which aligns better with human vision and reduces perceptual distortions in color adjustments.[12] For effective color transfer, perceptually decorrelated spaces like Lab and lαβ are preferred over RGB to mitigate artifacts from channel interdependencies. In RGB, correlations—such as high red and green values often accompanying high blue—can lead to unintended hue shifts or desaturation during statistical matching, as the channels are not orthogonal. The lαβ space, an opponent color model, further decorrelates luminance (l channel) from chrominance (α for yellow-blue, β for red-green) using a logarithmic transform and principal component analysis on cone responses, ensuring independent adjustments that preserve natural image statistics and minimize cross-channel interference.[13] This decorrelation is particularly advantageous for transfer tasks, as it allows precise modification of mood or palette without introducing color bleeding, unlike RGB where interdependent channels amplify errors. Conversion between spaces is crucial for applying transfer in uniform domains. The standard transformation from sRGB to Lab involves first linearizing the gamma-corrected RGB values, then applying a matrix to obtain CIE XYZ tristimulus values, followed by the nonlinear Lab mapping relative to a reference white point (e.g., D65 illuminant with ): where for , and otherwise, with as the white point tristimulus values.[12] Similarly, RGB to lαβ proceeds via XYZ to LMS cone responses, then logarithmic scaling and decorrelation. Perceptually uniform spaces like Lab and lαβ reduce transfer artifacts by enabling mappings that respect human color perception, such as avoiding over-saturation in correlated RGB channels—for instance, transferring a sunset's warm tones to a grayscale image in RGB might desaturate blues unexpectedly due to channel coupling, whereas lαβ maintains opponent balance. The foundational color transfer method of Reinhard et al. (2001) utilized the lαβ space to achieve superior results by addressing channel correlations present in RGB.Statistical Models
Statistical models form the foundation of many image color transfer techniques by representing the color distributions of source and target images as probability distributions, enabling the mapping of statistical properties such as means, variances, and higher-order moments. These models assume that colors in an image can be approximated by parametric distributions, allowing for straightforward parameter estimation and transfer. Early approaches treat color channels independently, while more advanced methods capture correlations and multimodality across channels. A prominent example is the univariate Gaussian model proposed by Reinhard et al., which assumes that the color distribution in each channel follows a Gaussian and operates in the decorrelated lαβ color space to minimize inter-channel dependencies. The method first computes the mean and standard deviation for each channel in both the source and target images. It then applies an affine transformation to match these first-order statistics: This transformation shifts the source channel to the target's mean and scales its variance accordingly, preserving the relative pixel ordering within each channel. The approach is computationally efficient and effective for images with similar compositional structures, as it relies on the assumption of unimodal, roughly Gaussian distributions per channel.[2] To handle non-Gaussian distributions, histogram-based models represent color distributions empirically via histograms and match them using cumulative distribution functions (CDFs). In this framework, the color transfer maps each source pixel value to a target value such that the CDFs align: , where and are the CDFs of the source and target distributions, respectively. This percentile-based matching ensures that the output histogram exactly replicates the target's, making it suitable for transferring global color palettes without parametric assumptions. Seminal work by Neumann et al. extended this to multidimensional hue, lightness, and saturation (HLS) histograms, enabling joint channel matching for more coherent transfers.[14] For capturing multimodal color distributions, such as those in images with distinct regions of varying hues, Gaussian mixture models (GMMs) decompose the joint color distribution into a weighted sum of Gaussians: , where is a color vector, are mixing coefficients, and are means and covariances. Color transfer involves estimating GMM parameters for source and target images, then aligning components via registration (e.g., matching similar Gaussians) and applying affine transforms to their parameters to transfer means, variances, and correlations. This approach better models complex scenes by accounting for multiple color clusters, as demonstrated in applications like probabilistic segmentation for local color transfer.[15] Optimal transport provides a non-parametric alternative for distribution alignment, formulating color transfer as minimizing the Wasserstein distance between source distribution and target , where denotes couplings and is the transport plan. This earth-mover's distance metric finds the most efficient pixel-to-pixel mapping in color space, preserving spatial structure less rigidly than parametric methods but yielding smoother gradients. Rabin et al. introduced relaxed optimal transport for color transfer, adapting the framework to handle discrete image histograms efficiently while regularizing for numerical stability.[7] Despite their strengths, global statistical models like these often assume unimodal or simply structured distributions, which can fail for complex images with multiple dominant colors or non-Gaussian tails, leading to over-smoothing or unnatural artifacts in transferred regions.[2]Algorithms
Global Transfer Methods
Global transfer methods apply a uniform color mapping to all pixels in an image, assuming consistent color statistics across the entire scene, which makes them computationally efficient and suitable for simple color correction tasks.[16] These approaches typically operate by matching low-order statistics, such as means, variances, or histograms, between a source image (the content to be modified) and a target image (providing the desired palette).[2] By working in decorrelated color spaces like lαβ or CIELAB, they minimize channel interactions and preserve perceptual uniformity during the transfer.[17]Histogram Matching
Histogram matching aligns the color distribution of the source image to that of the target by mapping the source's pixel values such that their histogram matches the target's shape, performed channel-by-channel in a decorrelated space to avoid artifacts from correlated channels like RGB.[17] The process begins by converting both images to a perceptually uniform space, such as CIELAB, where channels (L*, a*, b*) are relatively independent. For each channel, the cumulative distribution function (CDF) of the source histogram is computed and used to remap source values to those in the target whose CDF yields the same probability, ensuring the overall distribution matches exactly. This method is particularly effective for transferring broad tonal ranges and contrast but assumes independence between channels, which can lead to desaturation if correlations are strong.[17] A basic implementation of histogram matching per channel involves the following pseudo-code, adapted for equalization-like specification where the target histogram specifies the desired shape:function match_histogram(source_channel, target_channel, num_bins):
# Compute histograms
source_hist, source_edges = [histogram](/page/Histogram)(source_channel, bins=num_bins)
target_hist, target_edges = [histogram](/page/Histogram)(target_channel, bins=num_bins)
# Normalize to CDF
source_cdf = cumsum(source_hist) / sum(source_hist)
target_cdf = cumsum(target_hist) / sum(target_hist)
# Interpolate to find mapping: for each source bin, find target value with matching CDF
mapping = interpolate(target_cdf, target_edges[:-1], source_cdf)
# Apply mapping to source pixels
matched_channel = interp1d(source_edges[:-1], mapping, source_channel)
return matched_channel
function match_histogram(source_channel, target_channel, num_bins):
# Compute histograms
source_hist, source_edges = [histogram](/page/Histogram)(source_channel, bins=num_bins)
target_hist, target_edges = [histogram](/page/Histogram)(target_channel, bins=num_bins)
# Normalize to CDF
source_cdf = cumsum(source_hist) / sum(source_hist)
target_cdf = cumsum(target_hist) / sum(target_hist)
# Interpolate to find mapping: for each source bin, find target value with matching CDF
mapping = interpolate(target_cdf, target_edges[:-1], source_cdf)
# Apply mapping to source pixels
matched_channel = interp1d(source_edges[:-1], mapping, source_channel)
return matched_channel