Overview:
We are looking for a Big data platform engineer to help us build Big Data environments in the cloud, resolving data processing and improve the analytics platforms.
Responsibilities:
- Write and analyze queries, object oriented and/or scripting languages.
- Understand big data cloud based data technologies and applications.
- Design and implement end-to-end engineering solutions for business opportunities.
- Lead efforts to keep the big data platform operational.
- Identify technical obstacles early and work closely with the team to find creative solutions.
- Ability to grasp new technologies rapidly as needed to progress varied initiatives - Break down data issues and resolve them.
Requirements:
- 10+ Years of Exp with Hands on exp on Big data Architecture (HDFS,YARN), Cluster installation, configuration, monitoring, cluster security, cluster resources management, maintenance and performance tuning.
- Proficient in working with Linux or other POSIX operating systems, shell scripting.
- Proficient in scripting language like Python.
- Must be very comfortable with reading and de-bugging Scala, Python or Java code.
- Problem-solving and debugging skills with experience in one or more of the following languages: Java, Python, Scala.
- Software engineering experience and field in design, test, source code management, and CI/CD practices.