Resaro
builds advanced
AI testing software
to help organizations verify, validate, and trust their most critical AI systems — from
computer vision
to
generative AI
and
autonomous systems
. Our mission is to ensure that AI technologies deployed in real-world, high-stakes environments are robust, explainable, and secure.
We work closely with our customers through
embedded delivery teams
who operate on-site or in close collaboration. These teams tailor solutions to specific mission needs, helping organizations — especially in the
public safety and national security sectors
— evaluate and improve the performance of their AI-enabled systems.
About the Role:
As a
Solution Architect
at Resaro, you will be embedded in customer projects, acting as the primary interface between the customer’s mission teams and our internal technical teams. You will shape the design and delivery of
custom AI testing solutions
for a variety of application types, from chatbots and RAG agents to perception systems, object detection models and autonomous systems.
You will define solutions, guide engineering efforts, and ensure smooth delivery in complex, high-security settings.
Key Responsibilities:
Customer Engagement & Discovery:
- Lead early discovery sessions and solution workshops with defence and law enforcement agencies focused on national security and public safety.
- Map out client workflows and environment relating to data, processes, tools and orchestration.
- Identify customer pain points and translate them into actionable solution concepts.
Solution Design:
- Define the
AI testing, evaluation, verification and valuation (TEVV) roadmaps
tailored to GenAI or Computer Vision use cases.
- Adapt TEVV strategies for different modalities, such as image classification, segmentation, text generation, and autonomous perception.
- Prioritize features and tasks for the technical team based on mission value and delivery constraints.
- Contribute to the build, run and scale our Approved Intelligence Platform and AI Solution Quality Index (ASQI) incl. Our OSS project ASQI engineer for AI applications, e.g.:
- GenAI systems
: hallucination detection, prompt variability, multi-turn coherence.
Collaboration & Delivery:
- Work closely with Software Engineers, ML Scientists, and UI/UX designers to ensure solution quality.
- Build reusable project plans and proposals to accelerate engagement across clients with similar needs.
- Manage cross-functional teams and
oversee project delivery
, timelines, and deliverables.
- Act as the primary stakeholder interface and communicate progress and risks effectively.
Domain-Specific Insight:
- Understand customer AI development/deployment priorities, concerns, and pain points to pre-empt their solution needs.
- Understand technical deployment constraints in
high-security and high-sensitivity settings
, such as air-gapped networks, compliance, and cyber/information security requirements.
- Navigate procurement processes and support proposal development or tender responses.
Domain and AI Expertise:
- Guide the
hardening of AI systems
, identifying risks (e.g., hallucinations, prompt sensitivity) and potential solutions for defence and law enforcement teams.
- Provide insights on what and how to test Gen AI systems for use cases relevant to
defence and national security clients.
- Evaluate and recommend AI testing tools, platforms, and methods (e.g., PromptBench, LangSmith, OpenAI evals, CVAT, FiftyOne, DeepChecks), understanding their trade-offs.
Must-Have Skills and Experience:
Nice-to-Have:
- Technical background in ML, AI engineering, or data science.
- Hands-on experience with
AI tooling
(e.g.LangChain, LlamaIndex, YOLO, Detectron2, Hugging Face, FiftyOne, Nvidia).
- Familiarity with AI evaluation frameworks (e.g., LangSmith, PromptBench, OpenEval, VBench, MEVA).
- Prior experience navigating
government procurement processes
(RFIs, RFPs, SBIRs).
Why Join Resaro
- Work on
mission-critical AI systems
in defence, aerospace, and public safety.
- Help define the future of
AI testing and assurance
in real-world environments.
- Collaborate with a
tight-knit, expert team
working at the intersection of AI, systems engineering, and policy.
- Shape product direction while being close to the operational reality of AI deployments.
Resaro is an Equal Opportunity Employer. We respect each individual and support the diverse cultures, perspectives, skills and experiences within our teams.