About the Role

Software Engineer II role focused on Microsoft 365 Copilot inference infrastructure. You'll design, implement, and optimize core services for AI-driven capabilities at massive scale, working on GPU capacity management, LLM inference, and distributed systems.

Key Responsibilities

• Work with stakeholders to determine user requirements for features
• Contribute to design documents and identify dependencies with minimal oversight
• Implement and maintain code for services and features, reusing components
• Break down larger work items into smaller tasks and provide estimates
• Act as DRI during on-call rotations to monitor and restore services

Required Skills & Qualifications

Must Have:

• Bachelor's Degree in Computer Science or related field AND 2+ years technical engineering experience OR equivalent
• 2+ years experience building distributed, near real-time, high-load systems
• 2+ years experience translating requirements into feature implementations
• Ability to pass Microsoft Cloud background check

Nice to Have:

• Bachelor's Degree in Computer Science AND 4+ years experience OR Master's AND 2+ years
• Familiarity with modern software design patterns (microservices, containers, caching, queuing)
• Experience with CUDA kernels, CPU/GPU optimization, network latency, or large-scale capacity fleets

Benefits & Perks

• Industry leading healthcare