Data Engineer (with Airflow)

Back to job search
  • Location:

    McLean

  • Job type:

    Contract

  • Job ref:

    377383

  • Published:

    20 days ago

  • Expiration date:

    08/27/2022

  • Start date:

    ASAP

Job Summary:

Signature Consultants is seeking a Data Engineer for an opportunity with a client located in McLean, VA.

Responsibilities:

  • Collaborate as part of a cross-functional Agile team to create and enhance software that enables state of the art, next generation Big Data & Fast Data applications
  • Build software and frameworks to automate high-volume and real-time data delivery between
  • Collaborate as part of a cross-functional Agile team to create and enhance software that enables state of the art, next generation Big Data & Fast Data applications
  • Build software and frameworks to automate high-volume and real-time data delivery between our cloud based data platforms and applications
  • Build data APIs and data delivery services that support critical operational and analytical applications for our internal business operations, customers and partners
  • Leverage DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of software utilizing tools like Jenkins, Maven, Nexus, Chef, Terraform, Ruby, Git and Docker
  • Perform unit tests and conduct reviews with other team members to make sure the code is rigorously designed, elegantly coded, and effectively tuned for performance
  • Develop and deploy distributed computing Data applications using Spark or Pyspark
  • Utilize programming languages like Python and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Leverage DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of software utilizing tools like Jenkins, Maven, Nexus, Chef, Terraform, Ruby, Git and Docker
  • Perform unit tests and conduct reviews with other team members to make sure the code is rigorously designed, elegantly coded, and effectively tuned for performance
  • Develop and deploy distributed computing Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Nifi, Storm and Kafka on AWS Cloud
  • Utilize programming languages like Python and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake

Qualifications:

  • Bachelor's Degree or military experience
  • At least 3 years of professional work experience in data engineering
  • At least 3 years of experience with Python
  • At least 3 years of experience with Sql
  • At least 3 years of experience with Spark or Pyspark
  • At least 3 years of experience with ETL development
  • At least 2 year of experience working with cloud data capabilities - AWS
  • Build data APIs and data delivery services that support critical operational and analytical applications for our internal business operations, customers and partners
  • Sql experience
  • ETL experience


About Signature Consultants, LLC

Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 14th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit www.sigconsult.com. Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.

EEO Employer

Signature Consultants is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Signature will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or 888.838.1020.