Internal Systems Engineer (Applied AI)

Key Highlights

• Building robust internal software, integrations, and automations – such as developing custom FreshDesk widgets to support our agents. You will own the full lifecycle of these apps: building, hosting, monitoring, maintaining, and eventually retiring them when they’re no longer needed.
• API & Integration Expertise: Deep experience working with REST APIs. You can easily build connectors between distinct SaaS platforms to automate data flows and trigger actions.
• Applied AI Engineering: Hands-on experience with LLM orchestration frameworks (like LangChain or LangGraph). You understand MCPs, RAG pipelines, agentic workflows, DAG vs linear flows, engineering HITL systems, and have built real-world systems using these rails.
• AI Evaluation & Quality: Experience setting up and running evals for LLM outputs. You know how to build systems that grade, evaluate, and test AI responses for accuracy and safety (e.g., LLM-as-a-judge). You understand CI/CD for AI systems and can build regression testing pipelines.
• Platform Thinking: You don’t just build one-off tools – you think about how to make your work reusable. You can design templates, abstractions, and deployment patterns that other people (including non-engineers) can use to build on top of what you’ve created.