AWS Data Engineer
Experience
Salary
Location
Top Hiring Companies
.jpeg)
Job Description
JOB DESCRIPTION:
- AWS Data Engineer with minimum of 5 to 7 years of experience.
- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.
- Connect with stakeholders daily to discuss project progress and updates.
- Work within an Agile process to deliver projects in a timely and efficient manner.
- Design and develop Airflow DAGs to schedule and manage ETL workflows.
- Transform SQL queries into Spark SQL code for ETL pipelines.
- Develop custom Python functions to handle data quality and validation.
- Write PySpark scripts to process data and perform transformations.
- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.
- Run Spark jobs on AWS EMR cluster using Airflow DAGs.
- Monitor and troubleshoot ETL pipelines to ensure smooth operation.
- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.
- Collaborate with other members of the data engineering team to improve processes and implement new technologies.
- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.
Designation
AWS Data Engineer
Key Skills
Industry
IT-ITeS
Functional Area
IT Services
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Lead Generation Specialist
Bhū Rise Ventures LLP
Join the Bhū Rise Ventures LLP team as a Full Time Lead Generation Specialist on Erekrut, specializing in Lea...
3-6 Lakhs
1-3 Years
Uttar Prad..
Agile Develo...
Business Development Manager
Bhū Rise Ventures LLP
Join the Bhū Rise Ventures LLP team as a Full Time Business Development Manager on Erekrut, specializing in B...
3-6 Lakhs
4-6 Years
Uttar Prad..
Agile Develo...
Interior Designer
Mavericks Landmark
Join the Mavericks Landmark team as a Full Time Interior Designer on Erekrut, specializing in Interior Designe...
Confidential
1-3 Years
Maharashtr..
Agile Develo...
Business Development Executive
CROWN DECOR PRIVATE LIMITED
Join the CROWN DECOR PRIVATE LIMITED team as a Full Time Business Development Executive on Erekrut, specializi...
6-10 Lakhs
7-10 Years
Karnataka-..
Agile Develo...
Academic Counsellor
Eduinx
Join the Eduinx team as a Full Time Academic Counsellor on Erekrut, specializing in Academic Counsellor in the...
6-10 Lakhs
1-3 Years
Karnataka-..
Agile Develo...
ServiceNow Architect
SANAARI SOFTWARE SOLUTIONS PRIVATE LIMITED
Join the SANAARI SOFTWARE SOLUTIONS PRIVATE LIMITED team as a Full Time ServiceNow Architect on Erekrut, speci...
15-25 Lakhs
7-10 Years
Karnataka-..
Agile Develo...
Backend Executive (Operations)
Consurgo Ventures
Join the Consurgo Ventures team as a Full Time Backend Executive (Operations) on Erekrut, specializing in Back...
3-6 Lakhs
1-3 Years
Uttar Prad..
Agile Develo...
B2B Content Writer
Digiholic
Join the Digiholic team as a Full Time B2B Content Writer on Erekrut, specializing in B2B Content Writer in th...
3-6 Lakhs
1-3 Years
Maharashtr..
Agile Develo...
Top Hiring Companies
Top Locations
Top Skills
- Communication Skills (1998)
- Sales (1594)
- B2B Sales (605)
- Negotiation Skills (589)
- Effective communication (536)
- Cold Calling (511)
- Business Development (497)
- B2C Sales (453)
- Sales Activities (452)
- Customer Service (433)
- Lead Generation (414)
- Sales Management (373)
- Sales Planning (361)
- Customer Handling (346)
- Field Sales (343)
Top Sectors
- Sales (1687)
- Program Development (660)
- Marketing and Advertising (627)
- Human Resources (595)
- Consumer Service (565)
- Business Process Outsourcing (503)
- Business Development (393)
- BPO (357)
- Customer Service (356)
- Customer Support (318)
- Sales & Marketing (306)
- Executive Office (299)
- Digital Media Marketing (220)
- Manager (215)
- Design (210)