AWS Data Engineer
Experience
Salary
Location
Top Hiring Companies
.jpeg)
Job Description
JOB DESCRIPTION:
- AWS Data Engineer with minimum of 5 to 7 years of experience.
- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.
- Connect with stakeholders daily to discuss project progress and updates.
- Work within an Agile process to deliver projects in a timely and efficient manner.
- Design and develop Airflow DAGs to schedule and manage ETL workflows.
- Transform SQL queries into Spark SQL code for ETL pipelines.
- Develop custom Python functions to handle data quality and validation.
- Write PySpark scripts to process data and perform transformations.
- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.
- Run Spark jobs on AWS EMR cluster using Airflow DAGs.
- Monitor and troubleshoot ETL pipelines to ensure smooth operation.
- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.
- Collaborate with other members of the data engineering team to improve processes and implement new technologies.
- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.
Designation
AWS Data Engineer
Key Skills
Industry
IT-ITeS
Functional Area
IT Services
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Quality Inspector – PDI
Growth Electricals
Join the Growth Electricals team as a Full Time Quality Inspector - PDI on Erekrut, specializing in Quality In...
3-6 Lakhs
4-6 Years
Delhi-New ..
Agile Develo...
Business Development Executive
Ashtrix Robotics And Research Centre
Join the Ashtrix Robotics and Research Centre team as a Full Time Business Development Executive on Erekrut, s...
0-3 Lakhs
1-3 Years
Tamil Nadu..
Agile Develo...
Sales Specialist- Hospital
PRAJWAL SURGICAL AND SCIENTIFICS PVT LTD
Join the Prajwal Surgical and Scientifics Pvt Ltd team as a Full Time Sales Specialist- Hospital on Erekrut, s...
3-6 Lakhs
1-3 Years
Karnataka-..
Agile Develo...
Senior Graphic Designer &...
SOCIAL TRIBE
Join the SOCIAL TRIBE team as a Full Time Senior Graphic Designer on Erekrut, specializing in Senior Graphic D...
3-6 Lakhs
4-6 Years
Karnataka-..
Agile Develo...
3D Modeler – Human Anato...
ONE Simulation Pvt Ltd
Join the ONE Simulation Pvt Ltd team as a Full Time 3D Modeler on Erekrut, specializing in 3D Modeler in the H...
3-6 Lakhs
4-6 Years
Uttar Prad..
Agile Develo...
AI Evangelist – Public S...
Capabl India
Join the Capabl India team as a Full Time AI Evangelist on Erekrut, specializing in AI Evangelist in the EdTec...
10-15 Lakhs
4-6 Years
Karnataka-..
Agile Develo...
Senior Customer Support Engine...
Times Microwave Systems
Join the Amphenol Interconnect India Pvt Ltd team as a Full Time Senior CS Engineer on Erekrut, specializing i...
Confidential
4-6 Years
Karnataka-..
Agile Develo...
 Ltd..jpg)
Manager / Senior Manager ̵...
Muthoot Risk Insurance & Broking Services
Join the Muthoot Risk Insurance and Broking Services PVT LTD team as a Full Time Manager / Senior Manager - DM...
6-10 Lakhs
4-6 Years
Kerala-Ern..
Agile Develo...
Top Hiring Companies
Top Locations
Top Skills
- Communication Skills (1974)
- Sales (1593)
- Negotiation Skills (583)
- B2B Sales (556)
- Effective communication (536)
- Cold Calling (502)
- Sales Activities (452)
- B2C Sales (446)
- Business Development (439)
- Customer Service (415)
- Sales Planning (360)
- Sales Management (358)
- Lead Generation (354)
- Customer Handling (345)
- Field Sales (318)
Top Sectors
- Sales (1635)
- Program Development (660)
- Marketing and Advertising (626)
- Human Resources (593)
- Consumer Service (565)
- Business Process Outsourcing (503)
- BPO (357)
- Customer Service (355)
- Business Development (344)
- Customer Support (318)
- Executive Office (298)
- Sales & Marketing (296)
- Digital Media Marketing (215)
- Manager (206)
- Design (205)