About the Role
You will write low-level GPU code and optimize model architectures for efficient large-scale training and inference. You will integrate performance work into MLOps systems, profile and benchmark workloads across GPU clusters, and model LLM execution to estimate hardware use and serving performance.
Requirements
•Expertise writing custom low-level kernels
•Expertise with distributed GPU cluster infrastructure
•Knowledge of generative AI
•Knowledge of fine-tuning and language model applications
•Software design knowledge, including testing, code review, and CI/CD
Responsibilities
•Develop low-level GPU code, custom kernels, memory layouts, and communication optimizations
•Rethink generative-model architecture for efficient inference
•Integrate optimized code into the MLOps framework
•Profile and benchmark large-scale training and inference
•Model LLM execution across GPUs and estimate serving performance
