Description

Design and extend production-grade LLM applications and agentic workflows using

NestJS, XState v5, and the OpenAI SDK — flows include RAG, intent detection,

clarification, fulfillment, escalation, tool-use, and human-in-the-loop state machines

\- Build and maintain the conversation-machine substrate: guard/action registries, flow

validation (ajv), DB-driven flow configs, and design-time tooling in Epicenter admin

\- Build and evolve the AI systems behind Epic Support Assistant (ESA), the

player-facing support chatbot, and Agent Support Assistant, the AI copilot used by

customer support agents

\- Integrate with MCP servers (Model Context Protocol) for tool-use and agentic behaviors

\- Evaluate, benchmark, and tune models across providers including OpenAI, Gemini,

Anthropic, and future providers; own model selection decisions balancing quality,

latency, throughput, reliability, and cost

\- Troubleshoot production LLM issues including hallucinations, retrieval failures, prompt

regressions, model drift, token inefficiencies, latency bottlenecks, and provider outages

\- Build resilience mechanisms: retries, fallback routing, caching, streaming, rate limiting,

and provider routing

\- Instrument and tune model quality using Langfuse (tracing, evals, prompt

management), evaluation datasets, A/B testing, prompt versioning, and production

telemetry

\- Manage async workloads via BullMQ and caching with Redis; PostgreSQL persistence

via Kysely

Requirements

Must-Have

\- Proven experience building and operating production LLM-powered systems

similar in scope to chatbots, AI assistants, agent copilots, RAG systems, or LLM

orchestration platforms

\- Strong TypeScript/Node.js engineering; TypeScript strict-mode fluency

\- Production AI experience: prompt engineering, RAG pipelines, agent design, tool

calling, model evaluation, observability, and failure-mode analysis — you've shipped AI

features, not just prototyped them

\- Fullstack depth: comfortable moving between NestJS APIs, React UIs, databases,

infrastructure, and production operations; you don't artificially limit yourself to one layer

\- Ability to evaluate tradeoffs between model quality, latency, reliability, throughput,

and cost

\- Ability to troubleshoot AI systems across prompts, retrieval pipelines, model

configuration, infrastructure, and application code

\- State machine thinking — you naturally model complex async workflows; XState or

similar experience is a strong signal

\- Solid understanding of REST API design, async patterns (queues, events), and caching

strategies

\- Strong testing culture: unit, integration, and contract tests are first-class deliverables, not

afterthoughts

\- Experience working in a monorepo with multiple interconnected services

Strong Plus

\- Hands-on experience with MCP (Model Context Protocol) or building tool-use agentic

workflows

\- Familiarity with Langfuse or other LLM observability/evaluation platforms

\- Experience operating AI workloads at scale

\- Experience evaluating multiple foundation models and providers

\- Experience building AI copilots, assistants, or conversational products

\- Experience with semantic search and retrieval architectures

\- Experience with AI gateways such as Portkey or similar platforms

\- Experience with NestJS specifically: modules, providers, guards, interceptors, DI

patterns

\- Background in customer support or player support platforms — you understand the

stakes of getting AI-generated responses wrong

\- Experience shipping under low-latency constraints (chatbot response time budgets,

streaming)

\- Previous work in gaming or high-volume consumer products