About the Role

This senior role focuses on building and optimizing large-scale machine learning and LLM inference systems for Amazon's Sponsored Products and Brands advertising. The engineer will enhance training and inference automation, work with applied scientists on model performance, and develop infrastructure for GenAI workloads at Amazon Ads scale.

Key Responsibilities

• Enhance scalability, automation, and efficiency of large-scale training and real-time inference systems
• Pioneer development of LLM inference infrastructure for next-generation GenAI workloads at Amazon Ads scale
• Work closely with applied scientists to optimize machine-learning models and infrastructure
• Implement end-to-end solutions for machine learning systems
• Build advanced machine learning models and infrastructure from training to inference, including LLM-based systems

Required Skills & Qualifications

Must Have:

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team

Nice to Have:

• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent

Benefits & Perks

• Medical benefits
• Financial benefits
• Other benefits (equity, sign-on payments possible)