Experience
Salary
Location
What You'll Do :
- Design and implement data management services for data trust, data compliance, data access, and metadata management in the form of scalable and configurable while clearly articulating the technical rationale behind your design and implementation choices
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
Implementing ELT processes
- Monitoring performance and advising any necessary infrastructure changes
- Build data platforms and services to handle both real-time and batch processing of large data sets.
- Take end-to-end ownership of the design and implementation of core product functionality and key technical initiatives.
You are perfect for the role if you have :
- 3 to 8 years of data engineering experience in a fast-paced company that delivers software a deep understanding of designing and building highly scalable Data warehouses and Data pipelines.
- Hands-on Experience in SQL, Java/Scala programming languages.
- Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames.
- Create Java/Scala Spark jobs for data transformation and aggregation.
- Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.
- Good understanding of the architecture and functioning of Distributed database systems
- Experience working with various file formats like Parquet, Avro, etc for large volumes of data
- Experience with one or more NoSQL databases
- Strong understanding of engineering best practices and design principles
Data Engineer
Software Development
B2B
Full Time
Bachelor Degree
Work From Office
ETG CAREER LABS PRIVATE LIMITED
Join the ETG CAREER LABS PRIVATE LIMITED team as a Full Time Business Development Manager on Erekrut, speciali...
15-25 Lakhs
4-6 Years
Karnataka-..
Apache
Silvereye IT Solutions
Join the Silvereye IT Solutions team as a Full Time OpenShift Administrator on Erekrut, specializing in OpenSh...
10-15 Lakhs
4-6 Years
Karnataka-..
Apache
NxtLayer AI
Join the NxtLayer AI team as a Full Time S/4HANA SD Senior Consultant on Erekrut, specializing in S/4HANA SD S...
15-25 Lakhs
7-10 Years
Karnataka-..
Apache
NxtLayer AI
Join the NxtLayer AI team as a Full Time SAP IBP Consultant on Erekrut, specializing in SAP IBP Consultant in ...
15-25 Lakhs
7-10 Years
Karnataka-..
Apache
NxtLayer AI
Join the NxtLayer AI team as a Full Time SAP FICO Consultant on Erekrut, specializing in SAP FICO Consultant i...
10-15 Lakhs
7-10 Years
Karnataka-..
Apache
The Social Tribe
Join the The Social Tribe team as a Full Time Head of Growth & Ops on Erekrut, specializing in Head of Growth ...
10-15 Lakhs
7-10 Years
Karnataka-..
Apache
Enhance Design Studio Private Limited
Join the Enhance Design Studio Private Limited team as a Full Time Lead MEP Engineer on Erekrut, specializing ...
3-6 Lakhs
4-6 Years
Karnataka-..
Apache
TCI Supply Chain Solution
Join the TCI Supply Chain Solution team as a Full Time AM - Warehouse Operations on Erekrut, specializing in A...
6-10 Lakhs
7-10 Years
Karnataka-..
Apache