About
We are a Berlin-based startup that has successfully established a leading digital-first trading company for industrial metals across Europe.
Responsibilities
•Define and own the testing strategy across the platform - what gets tested at which layer (unit, component, contract, integration, end-to-end, production verification), where deterministic assertions end and statistical evaluation begins, and how quality gates map to release risk.
•Automated coverage across the React web app, backend APIs and services, auth and authorization, database operations, third-party integrations, email and document ingestion, background jobs and async workflows, multi-tenant configuration and isolation, and end-to-end RFQ and quotation journeys.
•Beyond happy-path responses: request and response schemas, permissions, invalid and incomplete inputs, error handling, idempotency and duplicate requests, timeouts and retries, async state transitions, webhooks and event processing, data consistency across services, tenant isolation, and integration failure and recovery - running in CI with enough diagnostic output to explain a failure.
•Versioned evaluation datasets built from real business scenarios, edge cases and observed failures. Targets include extraction accuracy, material and product matching, classification and routing, agent decision-making, generated RFQ and quotation content, grounding, hallucination frequency, instruction adherence and final business correctness.
•Inspect the whole execution path, not the final response: was the correct tool selected, were its arguments valid, were calls made in the right order, was the right source data used, were permissions and tenant boundaries respected, did retries and recovery work, did the agent stop or escalate when uncertain, did it avoid unnecessary actions, did the outcome match the business objective, and were latency and cost acceptable.
•Use bounded agents to analyse requirements, suggest missing scenarios, generate candidate tests, explore unusual journeys, create adversarial inputs, reproduce defects and analyse traces.
•Define and maintain the criteria: critical journeys pass, API contracts stable, no cross-tenant access violations, extraction accuracy above the agreed threshold, no material regression in agent task completion, known critical scenarios still succeeding, latency and cost within limits.
•Work a regression across layers - browser traces and screenshots, API requests, application logs, agent execution traces, database queries, background-job status, model outputs and grader results, deployment and config changes - and turn every meaningful production failure into a reproducible test or evaluation case.
•Deliverables: automated UI and API suites, integration and end-to-end scenarios, version-controlled AI evaluation datasets, agent-workflow graders, CI/CD quality gates, test and evaluation reports, release-readiness dashboards, regression and failure classifications, defect reproduction packages, quality-risk assessments, a living test strategy documenting layer ownership, coverage standards and evaluation methodology.
Requirements
•5+ years in SDET, quality engineering, test automation or software engineering.
•Strong TypeScript or Python, with experience designing maintainable test frameworks - not only writing test cases.
•Strong Playwright, pytest or comparable automation experience, and advanced API and integration testing knowledge.
•Experience defining test strategy for a platform or organisation - deciding what gets tested where and why, not only implementing someone else's plan.
•Experience testing asynchronous and distributed systems.
•SQL, logging and production-debugging skills; CI/CD and automated release gates.
•Strong judgment when requirements or outcomes are ambiguous - and the ability to distinguish technical correctness from business correctness.
•EU work permission.
Nice to have
•LLM and agent evaluations, trace-based debugging, model-based grading, prompt-injection and adversarial testing
•Multi-tenant SaaS platforms
•Email and document processing
•Procurement, manufacturing or supply-chain systems
•Data-quality and matching problems
Conditions
No conditions stated in the posting.
