GGeneral Intuition
Fullstack Engineer Data Platform
In short
This role owns infrastructure across data pipelines, GPU clusters, storage/I/O, and model-serving runtimes, with a focus on scheduling, throughput, inference latency, and multi-region reliability. The company builds preprocessing pipelines for raw gameplay video and works with action models, world models, and video understanding. It requires hands-on experience with Kubernetes, Python, Go, Rust, C++, Terraform, GPU cluster scheduling, and inference optimization techniques like batching, quantization, and KV cache. The position is onsite in the United States (New York) and full-time.
About the Role
You will own infrastructure across data pipelines, GPU clusters, storage and I/O, and model-serving runtime. You will optimize scheduling, throughput, inference latency, cloud infrastructure, infrastructure as code, multi-region deployment, and reliability while making technical design decisions for substantial production systems.
Requirements
•Infrastructure engineering experience
•Cluster scheduling
•GPU
•Data pipeline
•Disk I/O
•Network I/O
•Inference optimization
•Batching
•Quantization
•KV cache
•Cloud computing
•Infrastructure as code
•Multi-region deployment
•Kubernetes
•Python
•Go
•Rust
•C++
•Terraform
•Action model
•World model
•Video understanding
Responsibilities
•Own orchestration and GPU clusters
•Build preprocessing pipelines for raw gameplay video
•Optimize disk and network I/O
•Optimize production inference through batching, quantization, KV cache, and serving runtimes
•Own infrastructure as code, multi-region deployment, and reliability
•Make and carry technical design decisions to production
Benefits
•Equity
•Medical coverage
•Dental coverage
•Vision coverage
•401(k)
•Fertility benefits
•Parental benefits
•Generous PTO
•Daily meals
•Wellness benefits
•Commuter benefits
•Learning and development stipend