Senior / Lead Hadoop Engineer Job at NTT DATA Services, Charlotte, NC

Zi9yVE5CU0NsZGhSM1g4SUFqN2IxY29XdkE9PQ==
  • NTT DATA Services
  • Charlotte, NC

Job Description

Req ID:  297836  

 

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

 

We are currently seeking a Senior / Lead Hadoop Engineer to join our team in Charlotte , North Carolina (US-NC) , United States (US) .

 

Job Duties and Responsibilities:

 

In this role, you will:

  • Lead complex technology initiatives towards Hadoop platform stability, automation initiatives.
  • Platform Incident and Problem management
    • Be part of 24/7 platform support team to perform platform incident management and triaging team.
    • Assess the impact of the platform issue and prioritize the triage by partnering with platform tenants, platform development and Hadoop vendor teams.
    • Facilitate and perform root cause analysis of platform incidents towards determining permanent resolution involving Tenants and Hadoop vendor.
    • Communicate with Stakeholders, leadership team on the triaging progress status.
    • To troubleshoot tenant reported failures by deep diving onto client logs to identify the root cause.
    • Use Autosys as scheduler to schedule, execute platform routine activities.
  • Hadoop Cluster Monitoring
    • Monitor Hadoop cluster health and performance.
    • Automate new monitoring opportunities leveraging available monitoring and alerting tools such as Prometheus, Thousand Eyes, Splunk etc.
    • Perform troubleshooting on the actionable alerts and tuning to ensure optimal cluster performance.
  • Hadoop Cluster Configuration and tuning
    • Periodically tune and configure Hadoop ecosystem components such as HDFS, YARN, Hive, HBase, Spark, HPOS etc.
    • Schedule the Change request and track the approval process for implementation.
  • Platform Backup and Recovery:
    • Ensure Hadoop platform is resilient with data backup and recovery strategies in place.
    • Perform emergency or scheduled failover of platform to Disaster recovery site and fall back.
  • Upgrades and Patch Management:
    • Plan and execute upgrades of Hadoop ecosystem components and patches.
    • Ensure compatibility and smooth integration of new features and enhancements.
    • Work with Operating System administrators and patching automation build team to schedule and execute patching.
    • Perform Cluster health validation post patching and communicate with stakeholders.
    • Identify automation and process improvement opportunities related to patching to implement it.
  • Documentation and Reporting:
    • Maintain comprehensive documentation of Hadoop cluster configurations & troubleshooting processes, and procedures.
    • Develop and Schedule to Generate reports on cluster usage, performance metrics, and capacity utilization.
  • Collaboration and Support:
    • Ability to work both independently and in collaboration with Platform development and Platform tenant teams to troubleshoot and fix Hadoop platform issues, maintain production stability to enterprise-wide applications.
    • Collaborate and consult with key technical experts, senior technology team, and Hadoop vendor to resolve complex technical issues and achieve goals.

 

Basic Qualifications:

 

  • 8+ Years Proven Experience in technology incident and problem management role.
  • 4+ Years Proven Experience in using monitoring tools like Prometheus, Splunk, SiteScope & thousand eyes etc.,
  • 6+ Years Proven experience as a Unix Scripting
  • 2+ Years Proven experience in Hadoop administration or in a similar role.

 

Preferred Qualifications:

  • Strong knowledge of Hadoop ecosystem and its components (Hive, HBase, Spark, Hue ).
  • Proven Experience is using Autosys or similar job scheduler.
  • Excellent problem-solving and troubleshooting skills.
  • Excellent communication and people skills for collaborating with cross-functional teams.

 

#INDFSINS

#INDAPPS

#LI-PAS

 

About NTT DATA

 

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at  us.nttdata.com

 

NTT DATA is an equal opportunity employer and considers all applicants without regarding to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees. If you need assistance or an accommodation due to a disability, please inform your recruiter so that we may connect you with the appropriate team.

Job Tags

Permanent employment,

Similar Jobs

duvari group

Sr. Firmware Engineer Job at duvari group

 ...Join Our Team! We are seeking a highly skilled and motivated Senior Firmware Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining firmware for our cutting-edge products. You will work closely with cross... 

Direct Counsel, LLC

Civil Litigation Legal Secretary (minimum 10 years) Job at Direct Counsel, LLC

 ...witness and expert depositions Drafting correspondence Litigation legal secretary would work directly with two team oriented attorneys and be required to communicate directly with clients and legal offices and their staff on calendaring and other scheduling matters... 

Veolia

Intern - Field Engineering Job at Veolia

 ...deliver solutions that positively impact the environment. Come be part of something special - start your journey today! As the Field Engineering Intern you will be joining a strong technical service environment. In this role, you will have an opportunity to work... 

VDart Inc

Product Owner Job at VDart Inc

 ...Role: Product Owner Location: Louisville KY Duration:06 Months Job Description: ~ As a pivotal leader in our cybersecurity initiatives the Senior Scrum Master / Product Owner will facilitate and guide the development of critical security products.... 

Eaton

Machine Operator I - 3rd Shift Job at Eaton

 ...Hiring immediately! Eatons ES GEIS BLD division is currently seeking a Machine Operator I - 3rd Shift in Highland, IL. The core hours are Monday through Friday from 11:00 pm - 7:00 am. The rate for this position is $22.99 per hour plus an additional $.50 per hour shift...