AWS Data Engineer
Experience
Salary
Location
Top Hiring Companies
.jpeg)
Job Description
JOB DESCRIPTION:
- AWS Data Engineer with minimum of 5 to 7 years of experience.
- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.
- Connect with stakeholders daily to discuss project progress and updates.
- Work within an Agile process to deliver projects in a timely and efficient manner.
- Design and develop Airflow DAGs to schedule and manage ETL workflows.
- Transform SQL queries into Spark SQL code for ETL pipelines.
- Develop custom Python functions to handle data quality and validation.
- Write PySpark scripts to process data and perform transformations.
- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.
- Run Spark jobs on AWS EMR cluster using Airflow DAGs.
- Monitor and troubleshoot ETL pipelines to ensure smooth operation.
- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.
- Collaborate with other members of the data engineering team to improve processes and implement new technologies.
- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.
Designation
AWS Data Engineer
Key Skills
Industry
IT-ITeS
Functional Area
IT Services
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Agri Advisor
Growmize Pvt Ltd
Join the Growmize Pvt Ltd team as a Full Time Agri Advisor at Erekrut, specializing in Agriculture industry. W...
0-3 Lakhs
1-3 Years
Maharashtr..
Agile Develo...
Remote Desktop Support Enginee...
Renovision Automation Services Pvt. Ltd.
Join the Renovision Automation Services Pvt. Ltd. team as a Full Time Remote Desktop Support Engineer on Erekr...
0-3 Lakhs
0-1 Years
Maharashtr..
Agile Develo...
Manager-Design Engineering
Times Microwave Systems
Join the Amphenol Interconnect India Pvt Ltd team as a Full Time Manager-Design Engineering on Erekrut, specia...
15-25 Lakhs
11-15 Years
Karnataka-..
Agile Develo...
SCM Manager / Purchase Manager
Times Microwave Systems
Join the Amphenol Interconnect India Pvt Ltd team as a Full Time SCM Manager / Purchase Manager on Erekrut, sp...
15-25 Lakhs
11-15 Years
Karnataka-..
Agile Develo...
IT Sales Executive
Eorbitor Technology Private Limited
Join the Eorbitor Technology Private limited team as a Full Time IT Sales Executive at Erekrut, specializing i...
3-6 Lakhs
4-6 Years
Tamil Nadu..
Agile Develo...
Faculty For Medical College
Jdus Jobs
Join the Medical college team as a Full Time Faculty for Medical college at Erekrut, specializing in Healthcar...
15-25 Lakhs
0-1 Years
Tamil Nadu..
Agile Develo...
Faculty For Medical Colleges
Jdus Jobs
Join the Medical college team as a Full Time Faculty for medical colleges at Erekrut, specializing in Healthca...
15-25 Lakhs
0-1 Years
Tamil Nadu..
Agile Develo...
System Test Engineer
Freelance Recruiter
Join the Enphase Energy team as a Full Time System Test Engineer on Erekrut, specializing in System Test Engin...
25-50 Lakhs
11-15 Years
Karnataka-..
Agile Develo...