About the Role

Meta seeks a Research Engineer to join the content and user understanding team, focusing on Large Language Models (LLMs). The role involves building multi-modal LLM backbones, preparing data for pre-training and fine-tuning, and fine-tuning/RLHF for downstream tasks. The engineer will work on state-of-the-art LLMs to enhance user experiences across Meta's apps.

Key Responsibilities

• Build Multi-Modal LLM backbones
• Prepare human-labeled or auto-generated data for pre-training and fine-tuning
• Fine-tune/RLHF for downstream content understanding and user understanding tasks
• Model evaluation with human labeling or auto judge

Required Skills & Qualifications

Must Have:

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• Research experience in machine learning, deep learning, and/or natural language processing
• Experience with developing machine learning models at scale from inception to business impact
• Programming experience in Python and hands-on experience with frameworks such as PyTorch
• Understanding of architectural patterns of large scale software applications

Nice to Have:

• Experience in language model evaluation
• Experience in data processing for pre-training and fine-tuning
• Experience in LLM alignment
• Experience in reinforcement learning for language model tuning
• Experience in efficient training and inference
• Experience in multimodal modeling

Benefits & Perks

• bonus
• equity
• benefits