Back to jobsJob overview
About the role
Software Engineer II (Multiple Openings) at Microsoft
Required Skills
distributed systemscloud architecturegpu optimizationai infrastructurellm inferencec++pythonmicroservicesperformance optimization
About the Role
Software Engineer II role working on Microsoft 365 Copilot infrastructure, designing and optimizing core services for AI-driven capabilities at massive scale. You'll build distributed systems, improve inference performance, and ensure resiliency for millions of users across Teams, Outlook, Word, and PowerPoint.Key Responsibilities
- Work with stakeholders to determine user requirements for features
- Contribute to design documents and identify dependencies for product areas
- Implement and maintain code for services and features, reusing components
- Break down larger work items into smaller tasks and provide estimates
- Act as Designated Responsible Individual during on-call rotations
Required Skills & Qualifications
Must Have:
- Bachelor's Degree in Computer Science or related field AND 2+ years technical engineering experience
- 2+ years experience building distributed, near real-time, high-load systems
- 2+ years experience translating requirements into feature implementations
- Ability to pass Microsoft Cloud background check upon hire and every two years
Nice to Have:
- Bachelor's Degree AND 4+ years experience OR Master's Degree AND 2+ years experience
- Familiarity with modern software design patterns (microservices, containers, caching, queuing)
- Experience with CUDA kernels, CPU/GPU performance optimization, network latency, or managing large-scale capacity fleets
Benefits & Perks
- Industry leading healthcare