Back to jobsJob overview

About the role

Principal Applied Scientist at Microsoft

Required Skills

pythonpytorchtensorflowjaxllmsragagentic aimachine learningprompt engineering

About the Role

This role is for a Principal Applied Scientist/AI Architect focused on building and optimizing large language models (LLMs) and agentic AI systems. The candidate will translate research into production-ready algorithms and collaborate across teams to deliver scalable AI capabilities.

Key Responsibilities

  • Design and implement advanced LLM-based architectures and agentic systems for real-world product scenarios
  • Translate research breakthroughs into production-ready algorithms, contributing to core capabilities such as reasoning, planning, long-term memory, code-gen based design
  • Monitor and improve model performance post-deployment through data-driven iteration and error analysis
  • Collaborate across teams to deliver robust, scalable models aligned with product objectives and user value
  • Contribute to the organization’s scientific direction by identifying research opportunities that drive long-term differentiation

Required Skills & Qualifications

Must Have:

  • M.S. or Ph.D. in Computer Science, Machine Learning, or a related field, or equivalent practical experience
  • 5+ years of experience in applied machine learning, with a focus on LLMs, agent systems, or reinforcement learning
  • Strong hands-on experience with prompt engineering, context engineering, retrieval-augmented generation (RAG), tool use, planning agents, and long-context modeling
  • Familiarity with model training pipelines using PyTorch, TensorFlow, JAX, or similar frameworks, evaluation strategies, and model deployment best practices

Nice to Have:

  • Solid publication record (e.g., NeurIPS, ICLR, ACL, ICML, EMNLP)
  • Research-oriented mindset with publications in top AI/ML venues

Benefits & Perks

  • Industry leading healthcare