About The Role

We are seeking a highly skilled Senior Data Engineer to join our Data Platform team. In this pivotal role, you will be instrumental in shaping the data infrastructure that supports our fleet operations, hardware reliability, and advanced analytics initiatives. You will work closely with robot software and hardware teams to design, curate, and maintain high-quality datasets that enable deep insights, debugging, and fleet-scale analysis.

Your responsibilities will include developing robust ETL pipelines to transform raw telemetry and log data into structured, queryable datasets. You will contribute to on-robot data workflows, ensuring high fidelity and structured data capture, and collaborate across teams to optimize data models for various use cases. This role offers an exciting opportunity to work at the intersection of robotics, data engineering, and cloud infrastructure, directly impacting the reliability and intelligence of our robotic systems.

Qualifications

• 5+ years of experience as a Data Engineer or in a similar role, with a proven track record of building and maintaining production data pipelines.
• Strong proficiency in Apache Spark or equivalent distributed data processing frameworks.
• Experience with data orchestration tools such as Airflow, Dagster, or Prefect.
• Proficiency with data formats including Avro, Parquet, and structured/numeric datasets.
• Solid understanding of data modeling, schema evolution, and data quality best practices.
• Expertise in programming languages such as Python, Java, and/or Scala.
• Experience working with AWS data services like S3, Glue, Athena, and EMR or similar cloud platforms.
• Experience with vision data pipelines, including images, video, and depth data, and building derived datasets from them.
• Excellent ability to work cross-functionally with software, hardware, and analytics teams in a fast-paced environment.

Responsibilities

• Collaborate with robot software and hardware teams to define, collect, and curate data necessary for analytics and debugging purposes.
• Develop, implement, and maintain ETL pipelines that process raw telemetry and log data into structured datasets using Spark, Airflow, and AWS data services.
• Contribute to on-robot data workflows to ensure high-fidelity, well-structured data capture that supports downstream analysis.
• Design derived datasets and implement transformations across various data formats such as Avro and Parquet to support fleet operations and reliability analysis.
• Implement data quality checks, manage schema evolution, and oversee metadata using internal Data Registry and cataloging systems.
• Work closely with ingestion and storage services to facilitate efficient data movement into cloud data lakes (e.g., S3).
• Partner with reliability, analytics, and machine learning teams to design optimized data models for their workflows.
• Occasionally contribute to shared libraries or APIs in Python, Java, or C++ to enhance data capture and consumption capabilities.

Benefits

• 401(k) plan with a 6% company match to support your financial future.
• Equity through company stock options, offering ownership in the company's growth.
• Comprehensive insurance coverage including 100% paid medical, dental, vision, and short/long-term disability insurance.
• Benefits commence from your first day of employment, ensuring immediate support.
• Employee Assistance Program (EAP) providing well-being support.
• Flexible time off policies, including unlimited PTO for exempt employees and paid sick leave for non-exempt staff, along with recognized company holidays.
• On-site perks such as catered lunches four times a week and healthy snacks at Salem and Pittsburgh offices.
• Generous parental leave programs to support family growth.
• A supportive work environment that promotes flexible work arrangements.
• Opportunities for professional development, including tuition reimbursement programs.
• Relocation assistance is available for eligible candidates.

Equal Opportunity

Agility Robotics is committed to fostering an inclusive, diverse, and equitable work environment. We provide equal employment opportunities to all individuals regardless of race, color, religion, sex, sexual orientation, gender identity or expression, age, disability, marital status, citizenship, national origin, genetic information, or any other characteristic protected by law.