ML Compiler Engineer

Job Description

Job Title: ML Compiler Engineer , AWS Neuron, Annapurna Labs. Location: Toronto, Canada

Amazon Web Services (AWS) is hiring an ML Compiler Engineer for its Annapurna Labs Neuron team; The team develops the AWS Neuron Software Development Kit (SDK), which powers machine learning and GenAI workloads on custom accelerators such as Inferentia and Trainium.

Duties:

• Analyze and optimize machine learning model performance across frameworks, compilers, and runtime layers.
• Conduct detailed profiling of large-scale ML workloads to detect and fix system bottlenecks;
• Work directly with customers to help them deploy and optimize their ML models on AWS accelerators.
• Design and implement compiler optimizations and translate manual performance improvements into automated compiler passes.
• Collaborate with teams across compiler, runtime, and framework layers to deliver new performance capabilities;
• Work in an agile, fast-paced environment that emphasizes innovation, experimentation, and performance-driven results.

Qualifications:

• 3+ years of professional software development experience.
• 2+ years of experience in system design, reliability, and scaling of software systems.
• Strong programming background in Python or other modern languages;
• Bachelor’s degree in Computer Science, Electrical Engineering, or a related field (or equivalent experience).
• Experience with compiler design for CPU, GPU, or ML accelerators.
• Familiarity with LLVM, MLIR, or related compiler toolchains;
• Experience with PyTorch, JAX, TVM, or OpenXLA frameworks and deep learning algorithms.
• Knowledge of system-level performance optimization for distributed and high-performance computing environments.

Benefits and Instructions:

• Work with cutting-edge AWS ML accelerators used by global customers like Snap, Autodesk, and Amazon Alexa.
• Be part of a diverse and inclusive culture focused on innovation, mentorship, and work-life balance;
• Flexible working hours with opportunities for career growth and internal mentorship;
• AWS provides comprehensive health, equity, and career benefits;