Back to jobsJob overview

About the role

Principal Software Engineer, Agent Foundry (CoreAI) at Microsoft

Required Skills

pythonjavadistributed systemscloud infrastructurekubernetesai/mlagent frameworksazurelarge-scale platforms

About the Role

Principal Software Engineer role focused on building the next-generation Agent Foundry platform within Azure AI. The position involves designing large-scale hosting infrastructure and intelligent services for self-improving agents. Responsibilities include technical leadership, architectural decisions, and mentoring engineers.

Key Responsibilities

  • Lead design and development of large-scale hosting infrastructure and intelligent services
  • Shape platform's technical direction and drive architectural decisions
  • Own technical vision and architecture for scalable, secure agentic platform
  • Ensure platform security, compliance, and operational excellence
  • Mentor engineers and set best practices in distributed systems

Required Skills & Qualifications

Must Have:

  • Bachelor's degree in computer science or related field AND 6+ years technical engineering experience OR equivalent experience
  • 6+ years experience in software engineering with focus on distributed systems, large-scale data platforms, or cloud infrastructure
  • 4+ years experience working on design and delivery of complex, scalable systems
  • Ability to pass Microsoft Cloud background check

Nice to Have:

  • Experience with Agent based architectures, frameworks and technologies (MCP, A2A protocol, Langchain, Azure AI Foundry)
  • Proficiency in Java or Python
  • Experience with cloud services (Azure, AWS, GCP), container orchestration (Kubernetes), and big data frameworks
  • Familiarity with AI/ML workflows, training data pipelines, or synthetic data generation
  • Experience working in large, matrixed organization and influencing at scale
  • Experience mentoring teams and setting technical direction
  • 3+ years experience developing and deploying products at multiple points in product cycle
  • Experience building agents and working across agent frameworks

Benefits & Perks

  • Industry leading healthcare