FAR Labs

ai engineer for high-performance inference

In short

Lead role setting the technical direction for a high-performance LLM inference platform, driving benchmarking, serving speed and efficiency improvements, and leading the engineering team behind it. The company, FAR Labs, provides dedicated Inference and Model APIs across its own infrastructure, customer clouds, or shared GPUs. Requires production experience with LLM inference-serving systems (vLLM, SGLang, TensorRT-LLM), deep knowledge of batching, KV-cache management, and GPU performance engineering with CUDA/Triton, plus English B2. Fully remote position.

Описание: FAR Labs is a unified platform for high-performance AI inference. It provides dedicated Inference and Model APIs with flexible workload placement across its infrastructure, a customer's cloud or hardware, and shared GPUs.
Задачи:
•Set the technical direction for the inference stack and benchmarking practices
•Improve the speed and efficiency of model serving
•Validate performance gains with credible benchmarks
•Lead the engineers building the platform
•Shape the technology, performance standards, and engineering culture behind FAR Labs
Требования:
•Production experience with LLM inference-serving systems
•Expertise with vLLM, SGLang, TensorRT-LLM, or similar stacks
•Strong knowledge of batching, paged attention, KV-cache management, and modern serving architectures
•GPU performance engineering experience with CUDA or Triton
•Solid understanding of GPU utilisation, memory bandwidth, and precisions such as FP8 and FP4
•English B2
Условия: No conditions specified

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot