Data Engineer
Experience
Salary
Location
Top Hiring Companies
.jpeg)
Job Description
What You'll Do :
- Design and implement data management services for data trust, data compliance, data access, and metadata management in the form of scalable and configurable while clearly articulating the technical rationale behind your design and implementation choices
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
Implementing ELT processes
- Monitoring performance and advising any necessary infrastructure changes
- Build data platforms and services to handle both real-time and batch processing of large data sets.
- Take end-to-end ownership of the design and implementation of core product functionality and key technical initiatives.
You are perfect for the role if you have :
- 3 to 8 years of data engineering experience in a fast-paced company that delivers software a deep understanding of designing and building highly scalable Data warehouses and Data pipelines.
- Hands-on Experience in SQL, Java/Scala programming languages.
- Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames.
- Create Java/Scala Spark jobs for data transformation and aggregation.
- Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.
- Good understanding of the architecture and functioning of Distributed database systems
- Experience working with various file formats like Parquet, Avro, etc for large volumes of data
- Experience with one or more NoSQL databases
- Strong understanding of engineering best practices and design principles
Designation
Data Engineer
Key Skills
Industry
Software Development
Functional Area
B2B
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Manager-Design Engineering
Times Microwave Systems
Join the Amphenol Interconnect India Pvt Ltd team as a Full Time Manager-Design Engineering on Erekrut, specia...
15-25 Lakhs
11-15 Years
Karnataka-..
Apache
SCM Manager / Purchase Manager
Times Microwave Systems
Join the Amphenol Interconnect India Pvt Ltd team as a Full Time SCM Manager / Purchase Manager on Erekrut, sp...
15-25 Lakhs
11-15 Years
Karnataka-..
Apache
System Test Engineer
Freelance Recruiter
Join the Enphase Energy team as a Full Time System Test Engineer on Erekrut, specializing in System Test Engin...
25-50 Lakhs
11-15 Years
Karnataka-..
Apache
Staff Software Engineer-Python
Peak Hire Solutions
Join the Software Technology team as a Full Time Staff Software Engineer-Python at Erekrut, specializing in S...
50-75 Lakhs
11-15 Years
Karnataka-..
Apache
Business Development Executive
Intenim Technologies Pvt Ltd
Join the Intenim Technologies Pvt Ltd team as a Full Time Business Development Executive on Erekrut, specializ...
3-6 Lakhs
1-3 Years
Karnataka-..
Apache
Sales Executive
Intenim Technologies Pvt Ltd
Join the Intenim Technologies Pvt Ltd team as a Full Time Sales Executive on Erekrut, specializing in Sales Ex...
3-6 Lakhs
1-3 Years
Haryana-Gu..
Apache
Business Development Executive
Skysoft Works
Join the SkySoft Works team as a Full Time Business Development Executiv at Erekrut, specializing in Digital ...
Confidential
0-1 Years
Karnataka-..
Apache
Sr. Microsoft Dynamics 365 CRM...
Viamagus Technologies Pvt Ltd
Join the Viamagus Technologies Pvt Ltd team as a Full Time Sr. Microsoft Dynamics 365 CRM Developer on Erekrut...
25-50 Lakhs
7-10 Years
Karnataka-..
Apache