Resaro builds advanced AI testing software to help organizations verify, validate, and trust their most critical AI systems — from computer vision to generative AI and autonomous systems . Our mission is to ensure that AI technologies deployed in real-world, high-stakes environments are robust, explainable, and secure.

We work closely with our customers through embedded delivery teams who operate on-site or in close collaboration. These teams tailor solutions to specific mission needs, helping organizations — especially in the public safety and national security sectors — evaluate and improve the performance of their AI-enabled systems.

About the Role:

As a Solution Architect at Resaro, you will be embedded in customer projects, acting as the primary interface between the customer’s mission teams and our internal technical teams. You will shape the design and delivery of custom AI testing solutions for a variety of application types, from chatbots and RAG agents to perception systems, object detection models and autonomous systems.

You will define solutions, guide engineering efforts, and ensure smooth delivery in complex, high-security settings.

Key Responsibilities:

Customer Engagement & Discovery:

• Lead early discovery sessions and solution workshops with defence and law enforcement agencies focused on national security and public safety.
• Map out client workflows and environment relating to data, processes, tools and orchestration.
• Identify customer pain points and translate them into actionable solution concepts.

Solution Design:

• Define the AI testing, evaluation, verification and valuation (TEVV) roadmaps tailored to GenAI or Computer Vision use cases.
• Adapt TEVV strategies for different modalities, such as image classification, segmentation, text generation, and autonomous perception.
• Prioritize features and tasks for the technical team based on mission value and delivery constraints.
• Contribute to the build, run and scale our Approved Intelligence Platform and AI Solution Quality Index (ASQI) incl. Our OSS project ASQI engineer for AI applications, e.g.:
• GenAI systems : hallucination detection, prompt variability, multi-turn coherence.

Collaboration & Delivery:

• Work closely with Software Engineers, ML Scientists, and UI/UX designers to ensure solution quality.
• Build reusable project plans and proposals to accelerate engagement across clients with similar needs.
• Manage cross-functional teams and oversee project delivery , timelines, and deliverables.
• Act as the primary stakeholder interface and communicate progress and risks effectively.

Domain-Specific Insight:

• Understand customer AI development/deployment priorities, concerns, and pain points to pre-empt their solution needs.
• Understand technical deployment constraints in high-security and high-sensitivity settings , such as air-gapped networks, compliance, and cyber/information security requirements.
• Navigate procurement processes and support proposal development or tender responses.

Domain and AI Expertise:

• Guide the hardening of AI systems , identifying risks (e.g., hallucinations, prompt sensitivity) and potential solutions for defence and law enforcement teams.
• Provide insights on what and how to test Gen AI systems for use cases relevant to defence and national security clients.
• Evaluate and recommend AI testing tools, platforms, and methods (e.g., PromptBench, LangSmith, OpenAI evals, CVAT, FiftyOne, DeepChecks), understanding their trade-offs.

Must-Have Skills and Experience:

Nice-to-Have:

• Technical background in ML, AI engineering, or data science.
• Hands-on experience with AI tooling (e.g.LangChain, LlamaIndex, YOLO, Detectron2, Hugging Face, FiftyOne, Nvidia).
• Familiarity with AI evaluation frameworks (e.g., LangSmith, PromptBench, OpenEval, VBench, MEVA).
• Prior experience navigating government procurement processes (RFIs, RFPs, SBIRs).

Why Join Resaro

• Work on mission-critical AI systems in defence, aerospace, and public safety.
• Help define the future of AI testing and assurance in real-world environments.
• Collaborate with a tight-knit, expert team working at the intersection of AI, systems engineering, and policy.
• Shape product direction while being close to the operational reality of AI deployments.

Resaro is an Equal Opportunity Employer. We respect each individual and support the diverse cultures, perspectives, skills and experiences within our teams.