B.E/B.Tech Equivalent No of Years: 6+ Years
Areas of Work:
2+ years Hadoop Administration and Operations
1+ years Unix/Linux Skills, Java, SQL
•Hadoop Cluster administration and operations
•Experience in administration of HDFS, YARN, MapReduce, Hive, HBase, Zookeeper, Sqoop, Pig, Kafka, Spark, Strom, Ranger, Knox, Hue, Ambari, Falcon, HA and Security
•Basic Java and strong Linux administration skills
•Knowledge on Hortonworks Hadoop distribution (HDFS, YARN, MapReduce, Hive, HBase, Zookeeper, Sqoop, Pig, Kafka, Spark, Ranger, Knox, Hue, Ambari, Falcon, HA and Security)
•Implementation and ongoing administration of Hadoop infrastructure.
•Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
•Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing Hadoop Services access for the new users.
•Cluster maintenance as well as creation and removal of nodes using tools like Ambari
•Performance tuning of Hadoop clusters and Hadoop Applications.
•Screen Hadoop cluster job performances and capacity planning
•Monitor Hadoop cluster connectivity and security
•Manage and review Hadoop log files.
•File system management and monitoring.
•OS level support and maintenance.
•Ability to communicate comfortably with all levels of management and actively participate on leadership teams
•Improving and developing the knowledge & skills of others
•Ability to work closely with and develop relationships with clients
•Highly organized with a positive 'can do' attitude
•Knowledge of progress monitoring and reporting
•Able to handle communications
•Must be professional and respectful in all communications internally and externally