ai engineer for high-performance inference
In short
Lead role setting the technical direction for a high-performance LLM inference platform, driving benchmarking, serving speed and efficiency improvements, and leading the engineering team behind it. The company, FAR Labs, provides dedicated Inference and Model APIs across its own infrastructure, customer clouds, or shared GPUs. Requires production experience with LLM inference-serving systems (vLLM, SGLang, TensorRT-LLM), deep knowledge of batching, KV-cache management, and GPU performance engineering with CUDA/Triton, plus English B2. Fully remote position.