Hadoop/Kafka

Back to job search
  • Location:

    Berkeley Heights

  • Job type:

    Contract

  • Job ref:

    378927

  • Published:

    22 days ago

  • Expiration date:

    08/27/2022

  • Start date:

    ASAP

Job Summary:

Signature Consultants is seeking a Kafka SME for an opportunity with a client located in Berkeley Heights, NJ. Our client is looking for the ideal candidate to work a hybrid schedule (2 days on-site/3 days work from home).

Responsibilities:

  • Responsible for building a data integration platform to support engineering teams who are scaling up data integration
  • Lead detection and troubleshooting of issues that affect delivery of our Kafka services across multiple platforms
  • Maintain large Hadoop/spark clusters, adding, and removing nodes using cluster monitoring tools like Cloudera Manager, configuring the Name Node high availability, and keeping a track of all the running Spark jobs
  • Handles ServicePoint requests for questions, escalated SEV or direct client issues with Kafka, change tasks, incidents, and more
  • Develop support utilities for managing Kafka solutions used in payment processing
  • Create application monitoring scripts and automate alerts to inform technical teams of problems
  • Provide feedback, gathering information for research/validation, ensuring AppOps has all artifacts and information required to support production
  • Full participation in system maintenance events, standard windows, and escalation or assistance requests from other business units in support of One Fiserv
  • Participate in assigned projects representing the Debit Support organization, communicate status, issues, and delivery risks
  • Work with Change Management/Release Managers on the evaluation of change events and in planning work items for production deployment
  • Participate in code and infrastructure patch installations or fallbacks
  • Validate systems are operating as they should, following a completed installation of new code or patches to the environment
  • Document install and new defects, and assign severity to the problem that occurred, and work with various teams to determine root cause
  • Maintain and/or create technical support documentation, and work with offshore associates to assume the same
  • Assume support responsibilities for production items currently being supported by development, and train new FTE and offshore associates on supporting the same going forward
  • Ability to handle multiple concurrent projects and assignments and work with offshore associates to deliver
  • Team player with ability to demonstrate critical thinking, providing options, recommendations, and additional actions relating to resolving issues, mitigating risks and resolving escalated concerns
  • Work closely with Monitoring Engineering to ensure all relevant KPI's are implemented within the monitoring framework
  • Continuously improve our infrastructure to be easy to deploy, scalable, secure and fault tolerant

Requirements/Skills:

  • 4+ years of experience in Big Data/Hadoop/Spark admin skills
  • 4+ years of supporting medium to large installations of Hadoop/Spark clusters
  • Strong technical experience with KAFKA architecture
  • Experience in Kafka, Hadoop Cluster installation, configuration, and security administration
  • Knowledge of HDFS, MapReduce, Hive, Spark, HBase, Tez
  • Working knowledge of Zookeeper, Yarn, Ambari, Cloudera Manager
  • Experience with Lean / Agile development methodologies
  • Proficient in Linux commands and administration
  • Spark Administration
  • Point of contact for vendor escalation; be available for 24*7 support issues

About Signature Consultants, LLC

Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 14th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit www.sigconsult.com. Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.

EEO Employer

Signature Consultants is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Signature will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or 888.838.1020.