Back to jobsJob overview
About the role
Research Scientist Intern, 3D Perception, Understanding and Generative AI (PhD) at Meta
Required Skills
pythonpytorchcomputer vision3d geometrymachine learninggenerative aineural renderingunix
About the Role
This is a PhD-level research scientist internship focused on advancing 3D perception, understanding, and generative AI for AR/VR. The intern will work on cutting-edge computer vision and machine learning research, collaborating with teams to innovate in areas like egocentric 3D reconstruction and multimodal generative models. The role involves planning research, developing prototypes, and conducting experiments to push the state-of-the-art in machine perception.Key Responsibilities
- Plan and execute cutting-edge research to advance machine perception, state estimation, reconstruction, and rendering of 3D objects and scenes
- Collaborate with researchers and engineers across machine perception teams to develop experiments, prototypes, and concepts for AR/VR and AI systems
- Help design, setup, and run practical experiments and prototype systems related to large-scale high-quality sensing and machine reasoning
- Research novel computer vision and machine learning techniques for egocentric 3D reconstruction, scene understanding, and generative models
- Work on language grounding for 3D shapes and scenes to enable spatial reasoning and embodied interaction
Required Skills & Qualifications
Must Have:
- Currently has or is in the process of obtaining a PhD in computer vision, computer graphics, 3D machine perception, or machine learning
- Knowledge and hands-on experience with 3D and projective geometry, and image-space computer vision
- Hands-on experience implementing 3D computer vision algorithms and end-to-end training of ML models from data collection to evaluation
- Experience working within Python environments such as PyTorch
- Experience working in a Unix environment
- Must obtain work authorization in the country of employment at hire and maintain it during employment
Nice to Have:
- Proven track record of significant results demonstrated by grants, fellowships, patents, or first-authored publications at leading conferences like CVPR, ECCV/ICCV, SIGGRAPH, ICLR, NeurIPS
- Strong track-record of published research in neural reconstruction, inverse rendering, neural rendering, object reconstruction and tracking, generative modeling
- Strong programming experience using Python and PyTorch
- Demonstrated software engineer experience via internship, work experience, coding competitions, or open source contributions
- Intent to return to a degree-program after the internship
- Experience working and communicating cross functionally in a team environment