Let’s Connect Today!

NextGen Person

Hadoop Administrator in Maryland Heights, MO at NextGen

Date Posted: 11/9/2018

Job Snapshot

Job Description

Hadoop Administrator

Opportunity Overview

As a Hadoop Administrator, you will responsible for supporting, configuring, upgrading, and maintaining multiple Hadoop clusters for the organization. In addition you will contribute to building out additional clusters, adding nodes/capacity to existing clusters, and implementing open source projects.

What you'll do

  • Work with data engineers to support data ingest efforts (batch, micro-batch, and real-time)
  • Working with data delivery teams to setup new Hadoop clusters. This job includes setting up Kerberos principals and testing
  • Enable data encryption at rest and at motion with TLS/SSL to meet the security standards
  • Work with delivery teams for Provisioning of users into Hadoop.
  • Enable Sentry for RBAC (role-based access control) to have a privilege level access to the data in HDFS as per the security policies.
  • Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise
  • Performance tuning of Hadoop clusters and Hadoop MapReduce routines
  • Screen Hadoop cluster job performances and capacity planning
  • Monitor Hadoop cluster connectivity and security
  • Manage, Troubleshoot and review Hadoop log files
  • File system management and monitoring
  • HDFS and other Cloudera Hadoop components support and maintenance
  • Design and Implementation of Backup and Disaster Recovery strategy based out of Cloudera BDR utility
  • Strong scripting skills in Linux environment
  • Mentor others as necessary

Position Requirements

  • BS in Computer Science, or equivalent industry experience
  • 5+ years recent Cloudera Hadoop Administration experience
  • Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator's role
  • Intimate knowledge of fully integrated AD/Kerberos authentication
  • Experience setting up optimum cluster configurations
  • Debugging knowledge of YARN.