Job Description
Top Skills Details
1. 5+ years experience as a Platform Administrator (must be mid- senior level-- mid level 5-7 years, senior level 7+ years level in skill)
2. Strong troubleshooting skills (3+ years or more) and decision-making abilities to drive things on their own and make decisions.
3. Understanding of performance tuning in Big Data Hadoop world, proven experience with performance tuning, scalability and security in AWS environment. Experience with Shell or Linux scripting required.
Technical Environment:
Tech environment:
Hortonworks (HDFS, Hbase, Spark, Nifi, Spark), Kerberos
Clusters running in AWS - S3 buckets
Tereform, SAS, Ansible - DevOps tools
Performance tuning
Big Data tools
Using Kerberos for security
Ranger
Kafka, HDFS, Hive
Performance tuning and advancing big data tools. Whenever there is an issue or something is running slow this team jumps in and looks at it from an overall platform view. They need to figure out what needs to be changed in order to bring performance up again. If someone says they need "x" to fix the issues, they will put a POC in place, move it up to production and then finally onto their platform.
Additional Skills Tags
Nifi,Hadoop,Kafka,Spark,Node,Cluster,AWS,Hortanworks,Cloudera,platform,administrator
Additional Skills & Qualifications
The teams AI / ML footprint is also growing and they are building on the platform and serving use cases on the platform as well. They solve problems from the infrastructure side and do AI / ML on the infrastructure side as well. The team as a whole uses the Scrum methodology and each person is encouraged to be as self-driven as possible. It is an open, collaborative environment but is also high pressure. This team is the center of a large initiative for client and therefore is looked at by high-level leadership. This project, Data Platform was called out in front of CTO recently as the number 2 top initiative for client. It is a very high risk but high reward project for all involved. The engineers on the team are very supportive of one another and jump in to help each other when needed. A lot of the team members code for fun on the side as well. This team manages the production environment for Tier 1 and Tier 2 environments.