Back to jobsJob overview

About the role

Software Dev Engineer II - Neuron Kernel Interface , Annapurna Labs at Annapurna Labs (U.S.) Inc.

Required Skills

compilersmachine learningdistributed systemspythonpytorchtensorflowjaxhigh-performance computingaws

About the Role

The role involves developing a state-of-the-art compiler stack for AWS Neuron Kernel Interface to optimize machine learning models on custom accelerators like Inferentia and Trainium. You will build tools such as compilers, debuggers, and profilers to maximize ML performance and collaborate with customers to enable their ML kernels.

Key Responsibilities

  • Develop state-of-the-art tools (compiler, debugger, profiler) for ML model performance
  • Work with customers to enable and optimize ML kernels on AWS accelerators
  • Design and implement compiler optimizations
  • Collaborate across teams to develop innovative optimization techniques
  • Work in a startup-like environment on high-priority tasks

Required Skills & Qualifications

Must Have:

  • 3+ years of non-internship professional software development experience
  • 2+ years of design or architecture experience for new and existing systems
  • Experience programming with at least one software programming language

Nice to Have:

  • 3+ years of full software development life cycle experience
  • Bachelor's degree in computer science or equivalent
  • Experience in compiler design for CPU/GPU/Vector engines/ML-accelerators

Benefits & Perks

  • Inclusive team culture with affinity groups and learning experiences
  • Work/life balance with flexible working hours
  • Mentorship and career growth opportunities
  • Total compensation including equity, sign-on payments, and benefits