About Tensordyne
Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Through the creation of custom silicon, hardware and software, the company enables multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for hyperscaler and neocloud data center customers. Tensordyne is a well funded, fast-paced startup with headquarters in both Sunnyvale, CA, and Munich, Germany, with team members also working remotely across North America and Europe.
How much numerical precision does an LLM need, and where in the model architecture does it matter most? When does quantization improve runtime, and what does it cost in model quality? Tensordyne is looking for a motivated working student to help turn these questions into experiments and experiments into maintainable code. You'll explore optimization methods and build reusable evaluation tooling. You'll work closely with the quantization, compiler, and runtime engineers, and your findings will directly influence how models are optimized for Tensordyne hardware.
Задачи
•Model quality evaluation: Measure how low-precision computation affects performance on coding and reasoning benchmarks. Diagnose where quantization has the greatest impact.
•Quantization research: Implement and compare post-training quantization methods to improve inference efficiency while preserving task accuracy.
•Build reproducible tooling: Automate evaluations, track configurations and results, and make experiments accessible to engineers and AI agents.
•Measure runtime performance: Characterize latency, throughput, and memory usage to understand bottlenecks under different deployment scenarios.
A first project could involve exploring the quality–performance Pareto frontier of a Qwen or LlaMa model. You'll experiment with 16-bit, 8-bit, and 4-bit quantization configurations to find the best runtime-quality tradeoff.
Требования
•Current enrollment in Computer Science, Mathematics, Electrical Engineering, Machine Learning, or a related master's degree program.
•Strong Python and PyTorch skills, including the ability to understand and modify model implementations.
•Effective use of AI coding tools and critical review of their output.
•An experimental mindset: you can formulate hypotheses, design comparisons, and draw careful conclusions from noisy results.
•Clear communication and the ability to present experimental findings and technical tradeoffs to the team.
•Strong pluses: experience with quantization, LLM evaluation, performance profiling, or inference optimization.
•This role is for you if you thrive on responsibility, learn quickly, and are naturally proactive.
Условия
Join a deep-tech team building the next generation of AI inference systems. Put your university knowledge into practice with leading open-source LLMs, deepen your understanding of quantization and inference optimization, and build skills in experimental design, software engineering, and AI coding tools. You'll own a focused project, receive close mentorship from experienced engineers, and have room to explore ideas that shape the company's optimization methods.
