Data Engineer

Back to job search
  • Location:

    Chapel Hill, North Carolina

  • Job type:

    Contract

  • Job ref:

    337325

  • Published:

    about 1 month ago

  • Expiration date:

    07/23/2021

  • Start date:

    ASAP

Job Summary:

Signature Consultants is seeking a Data Engineer for an opportunity with a client located in Chapel Hill, NC. Our client is looking for a Data Engineer to build and deliver complex solutions for the new and existing products in Big Data Engineering.This candidate will be responsible for delivering technical and architectural excellence across Data Ingestion pipelines.

Primary Job Responsibilities:

  • Lead the effort of designing and developing new data/ETL pipelines
  • Write complex SQL queries to analyze and transform data on a distributed SQL engine
  • Analyze, debug and fix issues with data pipelines
  • Collaborate with DevOps and Production Support teams
  • Identify and Implement automation opportunities
  • Lead code reviews with peers and suggest/sign-off on changes
  • Document processes, issues, and resolutions as needed
  • Responsible for designing and developing new data and ETL pipelines in Spark, Scala, Java, Python and SQL using Big Data technologies including cloud computing, Hadoop, Hive, and HDFS
  • Responsible for leading and collaborate with DevOps and production support teams to analyze, debug, and resolve issues in production environment
  • Partner directly with product owners to identify business requirements and transform them into technical requirements and deliverables
  • Responsible for working in an agile Scrum driven environments

Qualifications (must have skills):

  • 5+ year experience implementing complex ETL pipelines
  • BS/MS in Computer Science or Engineering related fields
  • Strong experience in writing complex SQLs and ETL processes
  • Strong experience in Big Data stack of technologies, including Spark, Hadoop, HDFS and Hive
  • Strong experience with programming in one of the following. Python, Scala and/or Java
  • Practical experience in one of the could computing services (AWS, Azure or GCP)
  • Excellent written and verbal communication skills

About Signature Consultants, LLC

Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 14th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit www.sigconsult.com. Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.

EEO Employer

Signature Consultants is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Signature will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or 888.838.1020.