SENIOR DATA ENGINEER
Experience
Salary
Location
Top Hiring Companies
.jpeg)
Job Description
Roles and Responsibilities
- Design and develop scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, Kafka, and other relevant tools.
- Extract data from various applications using APIs, webhooks, or other methods.
- Ingest and process real-time data streams using Kafka.
- Transform and clean data to ensure data quality and consistency.
- Load data into ADLS Gen2 in optimized formats (e.g., Parquet, Delta Lake).
- Build and maintain data models and schemas.
- Collaborate with data analysts and business stakeholders to understand data requirements and deliver actionable insights.
- Optimize data pipelines for performance and cost-efficiency.
- Implement data governance and security best practices.
- Mentor junior data engineers and provide technical guidance.
Skills and Qualifications
- Strong proficiency in Python, Scala, or Java programming languages.
- Expertise in data engineering tools and technologies such as Azure Data Factory, Azure Databricks, ADLS Gen2, Kafka, and Delta Lake.
- Experience with cloud computing platforms, preferably Azure.
- Knowledge of data modelling, ETL/ELT processes, data warehousing, and real-time data processing concepts.
- Strong problem-solving and analytical skills.
- Ability to work independently and as part of a team.
- Excellent communication and interpersonal skills.
- Bachelor's degree in computer science, engineering, or a related field.
Preferred Qualifications
- Knowledge of machine learning and AI concepts.
- Certifications in Azure or related technologies.
- Experience with Node.js, Java or .NET Core for developing connector APIs.
Must-Have Technologies
- Python
- Scala or Java
- Azure Data Factory
- Azure Databricks
- ADLS Gen2
- Kafka
- Delta Lake
- SQL
This role offers a unique opportunity to work on challenging data engineering projects and contribute to the growth of our data-driven organization.
Designation
SENIOR DATA ENGINEER
Key Skills
Industry
Software Development
Functional Area
Technology, Information and Internet
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Integration Administrator R...
DigiFocal IT Solutions Pvt. Ltd.
Join the Digifocal It Solutions Pvt. Ltd. team as a Full Time Integration Administrator on Erekrut, specializi...
15-25 Lakhs
11-15 Years
Maharashtr..
.NET Core
Accountant
Plan B Associates India Pvt. Ltd
Join the Plan B Associates India Pvt. Ltd team as a Full Time Accountant on Erekrut, specializing in Accountan...
0-3 Lakhs
1-3 Years
Tamil Nadu..
.NET Core
Business Development Manager â...
Reliable Cabs Services Pvt Ltd
Join the Reliable Cabs Services Pvt Ltd team as a Full Time Business Development Manager on Erekrut, specializ...
Confidential
1-3 Years
Delhi-New ..
.NET Core
Sales Engineer – HVAC / ...
Boots2Suits Consultancy
Join the Boots2suits Consultancy team as a Full Time Sales Engineer - HVAC / VRV on Erekrut, specializing in S...
Confidential
4-6 Years
Maharashtr..
.NET Core
Academic Counsellor
Aspirantwave Global Education
Join the Aspirantwave Global Education team as a Full Time Academic Counsellor on Erekrut, specializing in Aca...
3-6 Lakhs
1-3 Years
Karnataka-..
.NET Core
Customer Advisor
Maven Sources
Join the Maven Sources team as a Full Time Customer Advisor at Erekrut, specializing in Healthcare industry. W...
15-25 Lakhs
0-1 Years
Tamil Nadu..
.NET Core
Area Sales Manager – Welding...
Ultramet Welds Pvt Ltd
Join the Ultramet Welds Pvt Ltd team as a Full Time Area Sales Manager – Welding on Erekrut, specializing in...
10-15 Lakhs
7-10 Years
Gujarat-Ah..
.NET Core
OMS Senior Developer
TOP TALENT HUNT LLP
Join the Mindtrilogy It Solution Pvt Ltd team as a Contract Basis OMS Senior Developer on Erekrut, specializin...
15-25 Lakhs
7-10 Years
Gujarat-Ah..
.NET Core