Drag Your GAN

About Drag Your GAN

Drag Your GAN is an innovative tool designed for interactive point-based manipulation of generative adversarial networks (GANs), enabling users to synthesize and control visual content with unprecedented precision. Developed by researchers from the Max Planck Institute for Informatics, MIT, and other esteemed institutions, Drag Your GAN allows users to manipulate the pose, shape, expression, and layout of generated objects by simply dragging points on an image. This interactive approach eliminates the need for manual annotations or prior 3D models, which often limit flexibility and precision. The tool employs a feature-based motion supervision system that guides the handle points towards target positions, ensuring accurate and realistic transformations. Additionally, a novel point tracking method leverages discriminative GAN features to maintain the localization of these handle points throughout the manipulation process. Users can manipulate a wide range of categories, including animals, vehicles, and landscapes, producing realistic outputs even in complex scenarios such as occluded content and shape deformation. Drag Your GAN not only enhances image manipulation capabilities but also supports real image manipulation through GAN inversion, making it a versatile tool for artists, designers, and researchers in the field of visual computing.