Send me more jobs like this

Keywords / Skills : database, Nagios, Software, Apache

3 - 5 years
Posted: 2018-11-29

Industry
IT/ Computers - Software
Function
IT
Role
Software Engineer/ Programmer
Posted On
29th Nov 2018
Job Ref code
2597220
Job Description
The typical responsibilities of a Hadoop admin include deploying a hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager, configuring the NameNode high availability and keeping a track of all the running hadoop jobs.

Implementing, managing and administering the overall hadoop infrastructure.
Takes care of the day-to-day running of Hadoop clusters
A hadoop administrator will have to work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected.
If working with open source Apache Distribution then hadoop admins have to manually setup all the configurations- Core-Site, HDFS-Site, YARN-Site and Map Red-Site. However, when working with popular hadoop distribution like Hortonworks, Cloudera or MapR the configuration files are setup on startup and the hadoop admin need not configure them manually.
Hadoop admin is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster.
Hadoop admin is also responsible for deciding the of the hadoop cluster based on the data to be stored in HDFS.
Ensure that the hadoop cluster is up and running all the time.
Monitoring the cluster connectivity and performance.
Manage and review Hadoop log files.
Backup and recovery tasks
Resource and security management
Troubleshooting application errors and ensuring that they do not occur again.

About Company

Summitworks enables organizations to efficiently and cost-effectively manage data quality for greater business assurance, sustainable compliance, risk reduction, fraud detection, enhanced profitability and improved business performance.

We provide data quality improvement services that support effective manufacturing, sales and marketing processes, enable more accurate invoicing and shipping, improve customer experience and foster many other immediate and long term business benefits.

Summitworks specializes in defining MDM
Vision
Strategy
Metrics
Technology
Similar Jobs
View All Similar Jobs
Walkin for you