AWS Data Engineer
Experience
Salary
Location
Top Hiring Companies
.jpeg)
Job Description
JOB DESCRIPTION:
- AWS Data Engineer with minimum of 5 to 7 years of experience.
- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.
- Connect with stakeholders daily to discuss project progress and updates.
- Work within an Agile process to deliver projects in a timely and efficient manner.
- Design and develop Airflow DAGs to schedule and manage ETL workflows.
- Transform SQL queries into Spark SQL code for ETL pipelines.
- Develop custom Python functions to handle data quality and validation.
- Write PySpark scripts to process data and perform transformations.
- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.
- Run Spark jobs on AWS EMR cluster using Airflow DAGs.
- Monitor and troubleshoot ETL pipelines to ensure smooth operation.
- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.
- Collaborate with other members of the data engineering team to improve processes and implement new technologies.
- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.
Designation
AWS Data Engineer
Key Skills
Industry
IT-ITeS
Functional Area
IT Services
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Software Engineer – Java
Viamagus Technologies Pvt Ltd
Join the Viamagus Technologies Pvt Ltd team as a Full Time Software Engineer – Java on Erekrut, specializing...
10-15 Lakhs
4-6 Years
Karnataka-..
Agile Develo...
Homologation Engineer
ERA Global Standards Certification
Join the ERA Global Standards Certification team as a Full Time Homologation Engineer on Erekrut, specializing...
3-6 Lakhs
1-3 Years
Tamil Nadu..
Agile Develo...
Human Resource Specialist
Philodesign Technologies
Join the Philodesign Technologies team as a Full Time Human Resource Specialist on Erekrut, specializing in Hu...
3-6 Lakhs
1-3 Years
Maharashtr..
Agile Develo...
Team Leader – Quality
Catalydd Engineering & Consulting Services LLP
Join the Catalydd Engineering & Consulting Services LLP team as a Full Time Team Leader - Quality on Erekrut, ...
0-3 Lakhs
4-6 Years
Tamil Nadu..
Agile Develo...
Techician Cum Rigger
Vedang Cellular Services Pvt Ltd
Join the Vedang Cellular Services Pvt Ltd team as a Full Time Techician cum rigger at Erekrut, specializing in...
0-3 Lakhs
1-3 Years
Karnataka-..
Agile Develo...
Agri Advisor
Growmize Pvt Ltd
Join the Growmize Pvt Ltd team as a Full Time Agri Advisor at Erekrut, specializing in Agriculture industry. W...
0-3 Lakhs
1-3 Years
Maharashtr..
Agile Develo...
Remote Desktop Support Enginee...
Renovision Automation Services Pvt. Ltd.
Join the Renovision Automation Services Pvt. Ltd. team as a Full Time Remote Desktop Support Engineer on Erekr...
0-3 Lakhs
0-1 Years
Maharashtr..
Agile Develo...
Manager-Design Engineering
Times Microwave Systems
Join the Amphenol Interconnect India Pvt Ltd team as a Full Time Manager-Design Engineering on Erekrut, specia...
15-25 Lakhs
11-15 Years
Karnataka-..
Agile Develo...