Back to jobsJob overview

About the role

Software Engineer II (Multiple Openings) at Microsoft

Required Skills

distributed systemscloud architecturegpu optimizationai infrastructurellm inferencec++pythonmicroservicesperformance optimization

About the Role

Software Engineer II role working on Microsoft 365 Copilot infrastructure, designing and optimizing core services for AI-driven capabilities at massive scale. You'll build distributed systems, improve inference performance, and ensure resiliency for millions of users across Teams, Outlook, Word, and PowerPoint.

Key Responsibilities

  • Work with stakeholders to determine user requirements for features
  • Contribute to design documents and identify dependencies for product areas
  • Implement and maintain code for services and features, reusing components
  • Break down larger work items into smaller tasks and provide estimates
  • Act as Designated Responsible Individual during on-call rotations

Required Skills & Qualifications

Must Have:

  • Bachelor's Degree in Computer Science or related field AND 2+ years technical engineering experience
  • 2+ years experience building distributed, near real-time, high-load systems
  • 2+ years experience translating requirements into feature implementations
  • Ability to pass Microsoft Cloud background check upon hire and every two years

Nice to Have:

  • Bachelor's Degree AND 4+ years experience OR Master's Degree AND 2+ years experience
  • Familiarity with modern software design patterns (microservices, containers, caching, queuing)
  • Experience with CUDA kernels, CPU/GPU performance optimization, network latency, or managing large-scale capacity fleets

Benefits & Perks

  • Industry leading healthcare