Researchers crack photography's toughest puzzle: separating light from color in any photo

Researchers Chris Careaga and Yağız Aksoy have developed a new method to decompose photographs into their fundamental components—diffuse albedo (surface color), colorful diffuse shading (illumination), and specular highlights (glare). Their work, presented at SIGGRAPH Asia and earning a Best Paper Honorable Mention, breaks the long-standing limitation of assuming single-color lighting and perfectly matte surfaces, enabling analysis of real-world photographs with complex, colorful lighting.

For developers and creators, this breakthrough unlocks practical tools for advanced image editing that were previously impossible. It allows for applications like physically accurate relighting, specular glare removal without damaging underlying textures, and per-pixel white balancing that preserves image quality. This brings professional-grade computational photography tools closer to everyday use in apps, games, and film.