Apply via OneDayHire - Fastest Job Connect Starts Here!

Job Description

Title: Senior Data Infrastructure Engineer

About the role

• As a Senior Data Infrastructure engineer, you will be working with Data Engineering, Analyst
• and Operations teams to build and maintain a secure, scalable and reliable data platform that
• powers our Enterprise Data Hub. The position requires thorough working knowledge of public
• cloud, big data fundamentals, excellent programming skills, experience with relational & non-
• relational databases, containerization, IAM & networking security and troubleshooting.

What You'll Do 

 Responsible for building and managing our cloud infrastructure (AWS) with code first

mindset.

 Design and architect ETL/ELT pipelines running on AWS EMR and Snowflake

 Performance tune data pipelines using technologies such as Apache Spark, Hive and Trino

 Write and maintain high-quality code and participate in design discussions and code reviews.

 Implement data storage solutions such as S3, ERDS and NoSQL databases.

 Automate workflows using orchestration systems like airflow, oozie etc.

 Build monitoring and observability dashboards.

 Cost optimization and management.

 Enforce security (create and maintain users and roles, assign privileges), establish procedures to ensure data integrity and availability.

 Perform on-call duties to keep the lights up 24x7.

 Setup and maintain documentation and standards.

About you

 BS degree in Computer Science or equivalent

 5+ years experience on public cloud such as AWS (preferred), Azure or GCP

 Solid programming skills in Java or Python and Shell

 Hands-on with Infrastructure as Code tools like Terraform or CloudFormation

 Experience with performance diagnostics, debugging and performance tuning.

 Familiarity with container software & platforms like Kubernetes, ECS etc.

 Excellent verbal, written and interpersonal communication