Math Libraries Engineer - Sparsity in AI

Job Description

Job Title: Senior Math Libraries Engineer - Sparsity in AI. Location: Remote, United States (Santa Clara, California, USA)

Responsibilities:

• Design and develop a C++-based system for accelerating unstructured sparsity workloads in deep learning and high-performance computing on NVIDIA GPUs
• Build support for Python, PyTorch, and other machine learning frameworks
• Develop solutions involving sparse tensor computations, sparse storage formats, and on-demand code generation
• Evaluate and improve system performance using real-world applications and workloads;
• Write reliable, maintainable, and thoroughly tested production-quality code
• Collaborate with product management and engineering teams to define features, performance goals, and technical roadmaps
• Contribute to advancements in accelerated computing, AI, and HPC technologies

Qualifications:

• BS, MS, or PhD in Computer Science, Applied Mathematics, or a related field, or equivalent experience
• 6+ years of experience developing, debugging, and optimizing high-performance software using C++ and parallel programming technologies
• Experience with sparse linear algebra applications and technologies such as CUDA, MPI, OpenMP, or equivalent frameworks;
• Experience designing domain-specific languages and compiler optimizations, particularly sparse compilers such as MLIR or TACO
• Strong programming skills in C++, Python, and CUDA
• Excellent communication, collaboration, and documentation skills

Preferred:

• Strong understanding of sparse computations and sparsity techniques for AI and HPC workloads
• Knowledge of large language models, deep learning methods, and machine learning frameworks
• Experience with low-level GPU performance optimization
• Understanding of numerical linear algebra methods, including direct and iterative solvers
• Experience with CI/CD systems, software development best practices, and project management tools such as JIRA

Benefits And Compensation:

• Base salary range: $184,000 to $287,500 per year (Level 4)
• Base salary range: $224,000 to $356,500 per year (Level 5)
• Equity opportunities
• Comprehensive employee benefits package
• Opportunity to work on cutting-edge AI, HPC, and accelerated computing technologies

Other Information:

• Remote position within the United States
• AI tools may be used during the recruitment process
• Equal opportunity employer committed to diversity and inclusion