About the Role

As a Solution Architect at Resaro, you will be embedded in customer projects, acting as the primary interface between the customer’s mission teams and our internal technical teams. You will shape the design and delivery of custom AI testing solutions for a variety of application types, from chatbots and RAG agents to perception systems, object detection models and autonomous systems.

You will draw on your understanding of both the defence environment and AI system behavior to define solutions, guide engineering efforts, and ensure smooth delivery in complex, high-security settings.

Key Responsibilities

Customer Engagement & Discovery

• Lead early discovery sessions and solution workshops with defence and law enforcement agencies focused on national security and public safety.
• Map out client workflows and environment relating to data, processes, tools and orchestration.
• Identify customer pain points and translate them into actionable solution concepts.

Solution Design

• Define the AI testing, evaluation, verification and valuation (TEVV) roadmaps tailored to GenAI or Computer Vision use cases.
• Adapt TEVV strategies for different modalities, such as image classification, segmentation, text generation, and autonomous perception.
• Prioritize features and tasks for the technical team based on mission value and delivery constraints.
• Contribute to the build, run and scale our Approved Intelligence Platform and AI Solution Quality Index (ASQI) incl. Our OSS project ASQI engineer for AI applications, e.g.: GenAI systems : hallucination detection, prompt variability, multi-turn coherence.
• CV systems : robustness to perturbations, real-world performance drift, fairness and edge case handling.

Collaboration & Delivery

• Work closely with Software Engineers, ML Scientists, and UI/UX designers to ensure solution quality.
• Build reusable project plans and proposals to accelerate engagement across clients with similar needs.
• Manage cross-functional teams and oversee project delivery , timelines, and deliverables.
• Act as the primary stakeholder interface and communicate progress and risks effectively.

Domain-Specific Insight

• Understand customer AI development/deployment priorities, concerns, and pain points to pre-empt their solution needs.
• Understand technical deployment constraints in high-security and high-sensitivity settings , such as air-gapped networks, compliance, and cyber/information security requirements.
• Navigate procurement processes and support proposal development or tender responses.

Domain and AI Expertise

• Guide the hardening of AI systems , identifying risks (e.g., hallucinations, prompt sensitivity) and potential solutions for defence and law enforcement teams.
• Provide insights on what and how to test Gen AI systems for use cases relevant to defence and national security clients.
• Evaluate and recommend AI testing tools, platforms, and methods (e.g., PromptBench, LangSmith, OpenAI evals, CVAT, FiftyOne, DeepChecks), understanding their trade-offs.

Must-Have Skills and Experience

• Partner with Product Management to translate product vision, customer problems, and market opportunities into end‑to‑end solution architectures and technical roadmaps that support a product-led growth strategy.
• 5+ years of experience as a Solution/Software/Cloud Architect or senior engineer designing customer-facing digital products or platforms, or a similar role.
• Strong foundation in Software Engineering - you are not just a "concept" person; you can read code ( e.g. Python), understand API structures, and validate overall technical feasibility by yourself.
• Experience working with or within defence or law enforcement teams, focusing on national security and public safety.
• Familiarity with common AI use cases like chatbots, RAG applications, agents, perception, surveillance and autonomous systems.
• Strong skills in requirements gathering , stakeholder communication, and solution scoping.
• Demonstrated success in leading cross-functional teams to deliver technical solutions.
• Understanding of AI/ML lifecycle and the state-of-the-art approaches and limitations of testing and validating complex models.
• Knowledge of deployment constraints in high-security or classified environments.

Nice-to-Have

• Technical background in ML, AI engineering, or data science.
• Hands-on experience with AI tooling (e.g.LangChain, LlamaIndex, YOLO, Detectron2, Hugging Face, FiftyOne, Nvidia).
• Familiarity with AI evaluation frameworks (e.g., LangSmith, PromptBench, OpenEval, VBench, MEVA).
• Experience contributing to AI risk management or AI assurance processes.
• Prior experience navigating government procurement processes (RFIs, RFPs, SBIRs).
• Prior experience in high-security, low-visibility agencies involved with defence, national security, or public safety.
• Prior exposure or experience with directly engaging senior stakeholders from Director to C-suite level.
• Prior security clearance at Government CONFIDENTIAL and above.

Why Join Resaro

• Work on mission-critical AI systems in defence, aerospace, and public safety.
• Help define the future of AI testing and assurance in real-world environments.
• Collaborate with a tight-knit, expert team working at the intersection of AI, systems engineering, and policy.
• Shape product direction while being close to the operational reality of AI deployments.