Improving AI-generated images, pixel by pixel

The issue is caused by the way the AI models are built.

This is part of what gives the models their seemingly magical ability to generate the images you describe in seconds.

“As a result, you can’t easily control specific parts of the images you generate.”

Reimagining image generation at the pixel level Luo’s lab and collaborators at the AI infrastructure company NVIDIA were one of the first teams to develop a model that trades the latent space for the pixel space, dubbed PixelDiT.

The team has since created an even more powerful model, PixelDiT2, that implements pixel space diffusion in an efficient way to achieve almost the same performance as the state-of-the-art latent space models but providing controllability over individual pixels.