Role description

At Tredence AWS Data Engineer designs, builds, and maintains scalable data pipelines and infrastructure using AWS services like Glue, S3, and Redshift, focusing on data ingestion, transformation (ETL), modeling, and quality. They write SQL and Python code, orchestrate workflows with tools like Airflow, and collaborate with data scientists and analysts, aiming to ensure data is accurate, accessible, and optimized for analysis and business decision-making.

Role – AWS Data Engineer
Years of Experience: 2~5 years

Roles and responsibilities

• The day-to-day work of a junior-to-mid AWS data engineer involves a mix of development, monitoring, and collaboration.
• Pipeline development: Designing, building, and maintaining robust and scalable ETL/ELT (Extract, Transform, Load) pipelines on AWS.
• Managing and optimizing cloud-based data warehouses like Amazon Redshift to support business intelligence and analytics.
• Implementing validation and cleansing techniques to ensure data accuracy and reliability throughout the pipeline.
• Managing data storage (e.g., S3), transformation services (e.g., Glue), and orchestration tools (e.g., Airflow/MWAA).
• Working closely with data analysts, data scientists, and business stakeholders to understand data requirements and deliver reliable data solutions.
• Monitoring and tuning data workflows and database queries to ensure fast and efficient processing.
• Creating clear and comprehensive documentation of data processes, infrastructure, and technical specifications.

Skills

Required Skills - AWS, Redshift, Lambda, Glue, S3, SQL, Python, Pyspark, Step function

Looking for immediate joiners

About Tredence
Welcome to Tredence! Since our founding in 2013, we have been dedicated to transforming data into actionable insights, helping over 50 Fortune 500 clients win in their respective industries. With our headquarters in San Jose and a presence in 5 countries, our mission is to be the world’s most indispensable analytics partner. At Tredence, we blend deep domain expertise with advanced AI and data science to drive unparalleled business value. We are excited to have you join us on this innovative journey.