SENIOR DATA ENGINEER
Experience
Salary
Location
Top Hiring Companies
.jpeg)
Job Description
Roles and Responsibilities
- Design and develop scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, Kafka, and other relevant tools.
- Extract data from various applications using APIs, webhooks, or other methods.
- Ingest and process real-time data streams using Kafka.
- Transform and clean data to ensure data quality and consistency.
- Load data into ADLS Gen2 in optimized formats (e.g., Parquet, Delta Lake).
- Build and maintain data models and schemas.
- Collaborate with data analysts and business stakeholders to understand data requirements and deliver actionable insights.
- Optimize data pipelines for performance and cost-efficiency.
- Implement data governance and security best practices.
- Mentor junior data engineers and provide technical guidance.
Skills and Qualifications
- Strong proficiency in Python, Scala, or Java programming languages.
- Expertise in data engineering tools and technologies such as Azure Data Factory, Azure Databricks, ADLS Gen2, Kafka, and Delta Lake.
- Experience with cloud computing platforms, preferably Azure.
- Knowledge of data modelling, ETL/ELT processes, data warehousing, and real-time data processing concepts.
- Strong problem-solving and analytical skills.
- Ability to work independently and as part of a team.
- Excellent communication and interpersonal skills.
- Bachelor's degree in computer science, engineering, or a related field.
Preferred Qualifications
- Knowledge of machine learning and AI concepts.
- Certifications in Azure or related technologies.
- Experience with Node.js, Java or .NET Core for developing connector APIs.
Must-Have Technologies
- Python
- Scala or Java
- Azure Data Factory
- Azure Databricks
- ADLS Gen2
- Kafka
- Delta Lake
- SQL
This role offers a unique opportunity to work on challenging data engineering projects and contribute to the growth of our data-driven organization.
Designation
SENIOR DATA ENGINEER
Key Skills
Industry
Software Development
Functional Area
Technology, Information and Internet
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Project Manager
Aspiration Cleantech Ventures Pvt. Ltd.
Join the Aspiration Cleantech Ventures Pvt. Ltd. team as a Full Time Project Manager on Erekrut, specializing ...
3-6 Lakhs
4-6 Years
Tamil Nadu..
.NET Core
Medical Sales Representative
Tynor Orhtotics Pvt Ltd
Join the Tynor Orhtotics Pvt Ltd team as a Full Time Medical Sales Representative on Erekrut, specializing in ...
3-6 Lakhs
7-10 Years
Tamil Nadu..
.NET Core
Strategic Account Manager
Right Advisors Private Limited
Join the Right Advisors Private Limited team as a Full Time Strategic Account Manager on Erekrut, specializing...
50-75 Lakhs
16-20 Years
Tamil Nadu..
.NET Core
Field / Key Account Manager
MTS Testing Solutions
Join the MTS Testing Solutions team as a Full Time Field / Key Account Manager on Erekrut, specializing in Fie...
10-15 Lakhs
11-15 Years
Maharashtr..
.NET Core
Sales Manager
TRP LOGISTICS PVT LTD
Join the TRP LOGISTICS PVT LTD team as a Full Time Sales Manager on Erekrut, specializing in Sales Manager in ...
0-3 Lakhs
4-6 Years
Tamil Nadu..
.NET Core
Java Full Stack Developer
Capgemini
Join the Capgemini team as a Full Time Java Full Stack Developer on Erekrut, specializing in Java Full Stack D...
15-25 Lakhs
7-10 Years
Tamil Nadu..
.NET Core
Business Development Executive
Ashtrix Robotics And Research Centre
Join the Ashtrix Robotics and Research Centre team as a Full Time Business Development Executive on Erekrut, s...
0-3 Lakhs
1-3 Years
Tamil Nadu..
.NET Core
 Ltd..jpg)
Manager / Senior Manager ̵...
Muthoot Risk Insurance & Broking Services
Join the Muthoot Risk Insurance and Broking Services PVT LTD team as a Full Time Manager / Senior Manager - DM...
6-10 Lakhs
4-6 Years
Kerala-Ern..
.NET Core
Top Hiring Companies
Top Locations
- Andaman Nicobar-Nicobar (7429)
- Andaman Nicobar-South Andaman (2497)
- Karnataka-Bangalore (1538)
- Delhi-New Delhi (1274)
- Maharashtra-Mumbai City (922)
- Tamil Nadu-Chennai (890)
- Haryana-Gurugram (717)
- Telangana-Hyderabad (642)
- Uttar Pradesh- Noida (597)
- Maharashtra-Pune (555)
- Gujarat-Ahmedabad (532)
- Work from Home (511)
Top Skills
- Communication Skills (2002)
- Sales (1594)
- Negotiation Skills (718)
- B2B Sales (617)
- Effective Communication (536)
- Cold Calling (512)
- Business Development (509)
- Lead Generation (504)
- B2C Sales (456)
- Sales Activities (452)
- Customer Service (436)
- Customer Relations (378)
- Sales Management (375)
- Sales Planning (362)
- Field Sales (348)
Top Sectors
- Adminstration (2413)
- Sales (1699)
- Program Development (661)
- Marketing and Advertising (627)
- Human Resources (595)
- Consumer Services (565)
- Business Process Outsourcing (503)
- Business Development (404)
- Customer Service (358)
- BPO (357)
- Customer Support (319)
- Sales & Marketing (310)
- Executive Office (299)
- Human Resources (HR) (293)
- Digital Media Marketing (220)