What You'll Do This opportunity involves both the “science” and “engineering” parts of research, two aspects that are of equal importance.

This is a multi-stack opportunity where you will work on the intersection of modeling, data, systems, and evaluation.

• Modeling: Architect large-scale multimodal models with a focus on pixel data. Solving challenges in both understanding of and generation of pixels.
• Data: Hillclimbing existing tasks and formulating new tasks through data. Design, implement, and run robust data pipelines for constructing, enriching, and filtering massive pixel datasets.
• Systems: Train large-scale multimodal models on massive datasets and GPU clusters.
• Evaluation: Define and build novel evaluation frameworks to measure pixel intelligence, from understanding (recognition, grounding, spatial-temporal perception...) to generation (realism, consistency, controllability, and human-aligned creative quality).

Who You Are

• Strong foundation in machine learning and foundation models, with experience in image, video, or multimodal domains.
• Deep understanding of autoregressive, diffusion/flow-based, or hybrid/unified models.
• Hands-on experience with PyTorch and large-scale training (distributed, mixed precision, large datasets).

What Sets You Apart (Bonus Points) Experience in the following around data, modeling, or evaluation:

• State-of-the-art foundation models in understanding pixels
• State-of-the-art foundation models in generating pixels

Your application are reviewed by real people.