
Zcodia Technologies is a reputed IT company operating in USA and India, specializing in web designing, mobile app development, ERP development, AI/ML, AR/VR, and digital marketing. They deliver…

Zcodia Technologies is a reputed IT company operating in USA and India, specializing in web designing, mobile app development, ERP development, AI/ML, AR/VR, and digital marketing. They deliver…
Your next opportunity is in here somewhere. Sign up to explore 52,000+ startups and their open roles. No spam. No gamification. Just jobs.
52,000+
Startups
65,000+
Open Roles
1,300+
New This Week
Job title
Senior Data Engineer / Databricks Engineer
Work mode - Hybrid / Remote
Location - Chennai
Experience - 5+ years overall; 3–5+ years hands‑on with *Databricks + PySpark / Spark SQL*
Key responsibilities
Design and build *scalable ETL/ELT pipelines* on *Databricks (Azure/AWS/GCP)* using *PySpark, Spark SQL, and Scala/Python*.
Implement *Delta Lake* patterns (bronze/silver/gold layers, schema evolution, CDC, Z‑order, optimized storage) for high‑quality, governed data assets.
Integrate data from multiple sources (databases, APIs, files, streaming) into cloud data lakes/warehouses and orchestrate via *Databricks Workflows, ADF, Airflow, or similar*.
Monitor pipeline performance, tune Spark jobs, optimize cluster configs, and ensure cost‑efficient lakehouse operations.
Collaborate with data analysts, data scientists, and business stakeholders to translate requirements into production‑ready data models on Databricks.
Follow DevOps practices (Git, CI/CD) and security/governance standards (Unity Catalog, RBAC, data‑lineage and monitoring).
Mandatory skills
5+ years in data engineering / data warehousing.
3–5+ years in *Databricks* (notebooks, clusters, jobs, workflows, Delta Lake).
Strong hands‑on with *PySpark / Spark SQL* and *Python / Scala*.
Experience with at least one cloud platform: *Azure (ADLS, ADF, Synapse) or AWS (S3, Glue, EMR)* or GCP.
Good understanding of *relational data‑warehouse concepts, dimensional modeling, and SQL*.
Familiarity with *ETL/ELT tools* (e.g., Azure Data Factory, Informatica, Airflow) is a plus.