About the Role

This is a PhD-level research scientist internship focused on developing high-performance software for Meta's AI accelerator hardware. The role involves optimizing AI frameworks, compiler stacks, and kernel libraries to accelerate deep learning models like recommendation systems and generative AI. Interns will work on performance tuning and collaborate with AI research scientists.

Key Responsibilities

• Development of software stack with focus on AI frameworks, compiler stack, or high-performance kernel development
• Contribute to PyTorch AI framework core compilers for new AI hardware accelerators
• Analyze deep learning networks and implement compiler optimization algorithms
• Collaborate with AI research scientists to accelerate next-generation deep learning models
• Performance tuning and optimizations of deep learning framework and software components

Required Skills & Qualifications

Must Have:

• Currently has or is obtaining a PhD in Computer Science or related STEM field
• C/C++ programming skills
• Must obtain work authorization in country of employment
• Knowledge of Computer Architecture and Distributed systems with interest in High Performance Computing, Numerics, Performance, or AI hardware

Nice to Have:

• Experience with compiler optimizations (loop optimizations, vectorization, etc.) and tools like MLIR, LLVM, IREE, XLA, TVM, Halide
• Experience in developing training and inference framework components and system performance optimizations
• Experience with CUDA, OpenMP/OpenCL, or AI hardware accelerator kernel programming and libraries like cuBLAS, cuDNN, CUTLASS, HIP, ROCm
• Experience working with frameworks like PyTorch, Caffe2, TensorFlow, ONNX, TensorRT
• Knowledge of GPU, CPU, or AI hardware accelerator architectures
• Proven track record of significant results via grants, patents, or first-authored publications
• Demonstrated software engineer experience via internships, work, coding competitions, or open-source contributions
• Intent to return to degree-program after internship

Benefits & Perks

• CA$6,240/month to CA$10,334/month + benefits