What You’ll Be Doing

• Build and maintain real-time and batch data pipelines using tools like Kafka, Spark, and Airflow.
• Contribute to the development of a scalable LakeHouse architecture using modern data formats such as Delta Lake, Hudi, or Iceberg.
• Contribute to building data products for inbound (ingestion) and outbound (consumption) use cases across the organization.
• Optimize data ingestion and transformation workflows across cloud platforms (AWS, GCP, or Azure).
• Support data quality, lineage, and observability using modern practices and tools.
• Participate in Agile processes (Sprint Planning, Reviews) and contribute to team knowledge sharing and documentation.
• Proficient in building pipelines on AWS, GCP, or Azure using managed services and cloud-native tools.
• Experience in Airflow or similar orchestration platforms.
• Strong in data modeling and optimizing data warehouses like Redshift, BigQuery, or Snowflake.

What You’ll Bring To The Role

• 7-9 years of experience in data engineering or backend systems with a focus on large-scale data pipelines
• Working knowledge of LakeHouse formats (Delta/Hudi/Iceberg) and columnar storage like Parquet.
• Expertise in data modeling and optimizing data warehouses like Redshift, BigQuery, or Snowflake.
• Exposure to real-time OLAP tools like ClickHouse, Druid, or Pinot.
• Familiarity with observability tools such as Grafana, Prometheus, or Loki.
• Some experience integrating data with MLOps tools like MLflow, SageMaker, or Kubeflow.
• Bachelors or Masters Degree in Engineering

Perks & Benefits

• Excellent medical insurance options and free online doctor consultations
• Yearly privilege and sick leaves as per Karnataka S&E Act
• Generous holidays (National and Festive) recognition and parental leave policies
• Learning & Development fund to support your continuous learning journey and professional development
• Fun events to build culture across the organization
• Flexible benefit plans for tax exemptions (i.e. Meal card, PF, etc.)

Our Commitment to Inclusion and Belonging Observe.AI is an Equal Employment Opportunity employer that proudly pursues and hires a diverse workforce. Observe AI does not make hiring or employment decisions on the basis of race, color, religion or religious belief, ethnic or national origin, nationality, sex, gender, gender identity, sexual orientation, disability, age, military or veteran status, or any other basis protected by applicable local, state, or federal laws or prohibited by Company policy. Observe.AI also strives for a healthy and safe workplace and strictly prohibits harassment of any kind. We welcome all people. We celebrate diversity of all kinds and are committed to creating an inclusive culture built on a foundation of respect for all individuals. We seek to hire, develop, and retain talented people from all backgrounds. Individuals from non-traditional backgrounds, historically marginalized or underrepresented groups are strongly encouraged to apply. If you are ambitious, make an impact wherever you go, and you're ready to shape the future of Observe.AI, we encourage you to apply. For more information, visit www.observe.ai.