AWS Data Engineer
Experience
Salary
Location
Top Hiring Companies
.jpeg)
Job Description
JOB DESCRIPTION:
- AWS Data Engineer with minimum of 5 to 7 years of experience.
- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.
- Connect with stakeholders daily to discuss project progress and updates.
- Work within an Agile process to deliver projects in a timely and efficient manner.
- Design and develop Airflow DAGs to schedule and manage ETL workflows.
- Transform SQL queries into Spark SQL code for ETL pipelines.
- Develop custom Python functions to handle data quality and validation.
- Write PySpark scripts to process data and perform transformations.
- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.
- Run Spark jobs on AWS EMR cluster using Airflow DAGs.
- Monitor and troubleshoot ETL pipelines to ensure smooth operation.
- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.
- Collaborate with other members of the data engineering team to improve processes and implement new technologies.
- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.
Designation
AWS Data Engineer
Key Skills
Industry
IT-ITeS
Functional Area
IT Services
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Academic Counsellor
Aspirantwave Global Education
Join the Aspirantwave Global Education team as a Full Time Academic Counsellor on Erekrut, specializing in Aca...
3-6 Lakhs
1-3 Years
Karnataka-..
Agile Develo...
General Manager – Sales ...
Vatsgroup India Private Limited
Join the Vatsgroup India Private Limited team as a Full Time General Manager - Sales (PEB) on Erekrut, special...
10-15 Lakhs
4-6 Years
Uttar Prad..
Agile Develo...
Technical Artist
ALTOURA INDIA PRIVATE LIMITED
Join the ALTOURA INDIA PRIVATE LIMITED team as a Full Time Technical Artist on Erekrut, specializing in Techni...
10-15 Lakhs
4-6 Years
Karnataka-..
Agile Develo...
Unity Developer
ALTOURA INDIA PRIVATE LIMITED
Join the ALTOURA INDIA PRIVATE LIMITED team as a Full Time Unity Developer on Erekrut, specializing in Unity D...
15-25 Lakhs
4-6 Years
Karnataka-..
Agile Develo...
Telesales Executive
La Densitae Clinic Ltd
Join the La Densitae Clinic Ltd team as a Full Time Telesales Executive on Erekrut, specializing in Telesales ...
3-6 Lakhs
1-3 Years
Maharashtr..
Agile Develo...
Customer Advisor
Maven Sources
Join the Maven Sources team as a Full Time Customer Advisor at Erekrut, specializing in Healthcare industry. W...
15-25 Lakhs
0-1 Years
Tamil Nadu..
Agile Develo...
HR Operations Executive
Nuest Consulting
Join the Nuest Consulting team as a Full Time HR Operations Executive on Erekrut, specializing in HR Operation...
3-6 Lakhs
1-3 Years
Maharashtr..
Agile Develo...