Задачи
•Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
•Integrate models and providers into gateway solutions for enterprise-scale operations
•Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
•Establish observability and resilience mechanisms to maintain production stability
•Implement LLM routing and broker logic to optimize model performance and reliability
•Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
•Take ownership of gateway implementation projects and deliver functional solutions rapidly
•Collaborate with cross-functional teams to align gateway operations with organizational security standards
•Monitor and troubleshoot production systems to ensure continuous availability
Требования
•5+ Years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations
•Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety
•Proficiency in LiteLLM and other LLM gateway platforms
•Knowledge of LLM security, PII detection and redaction, and enterprise policy enforcement
•Understanding of LLM routing, broker logic, and token/rate control mechanisms
•Skills in observability, resilience engineering, and production system operations
•Capability to take ownership and deliver functional gateway implementations rapidly
•English proficiency at B2 level or higher
Условия
No conditions specified
