Senior Data Engineer

Back to job search
  • Location:

    Oakland

  • Job type:

    Contract

  • Job ref:

    379616

  • Published:

    15 days ago

  • Expiration date:

    08/31/2022

  • Start date:

    ASAP

Job Summary:

Signature Consultants is seeking a Senior Data Engineer for an opportunity with a client located in Oakland, CA. Our client is looking for a team player that not only can provide on-going Production Support of their growing portfolio of apps, but is creative in architecting, and developing POCs data solutions. The candidate should be collaborative and is someone who can up-skill the rest of the team:

Responsibilities:

  • Provide full lifecycle app development support of RDBMS (MySQL, Oracle, SQL Server), Data Warehouse, Data Lake, Business Intelligence Reporting (Tableau), and related services on primarily AWS Cloud and On-Prem
  • Work as a general administrator providing support for production, development and QA big data platforms
  • Responsible for big data, data lake, data mart, data warehouse and reporting (canned/ad hoc/business intelligence) administration
  • Work with the data architecture team, application architecture team, development teams, QA team, and production operations to implement systems in production
  • Responsible for big data software installations, configurations, patches, upgrades and other related activities
  • Responsible for big data, data lake backups and restores
  • Develop, maintain and publish disaster recovery plans, system requirement definitions, technical evaluation reports, operations readiness plans, capacity planning documents, and security administration procedures
  • Set up access privileges to big data and data lake sources, and create user security profiles
  • Monitor data lakes for resource utilization
  • Provide trend analysis for forecasting future resource requirements
  • Monitor and optimize the use of disk space
  • Initiate corrective action to ensure all big data servers meet processing requirements for performance and reliability
  • Provide recommendations on hardware and software upgrade alternatives
  • Conduct software audits of big data products for compliance with established standards, policies, configuration guidelines and procedures
  • Maintain high levels of internal customer satisfaction with utmost respect and dedication
  • Meet or exceed mutually established key objectives
  • Maintain high level of standards in interpersonal skills such as verbal and written communications
  • Maintain high level of technical skills and strive to expand on technical knowledge through self-education or company provided education
  • Follow and enforce IT corporate standards and policies
  • Provide support to in-house and remote personnel


Technical Requirements/Competencies:

  • Successful history of acting as the Data Engineer or Big Data Analytics Administrator on full life-cycle applications development projects, packaged software implementation projects, and data warehousing projects
  • Big Data Management techniques including logical data modeling, physical data lake optimization, data distribution, and data lake and data hub performance monitoring and tuning
  • Knowledge of Oracle, MySQL and SQL Server Databases, JBoss Platform, RHEL, Windows Servers, Java, Python, Scala, SQL, Shell Scripting, and file transfer tools
  • Knowledge of DB Design tools such as Embarcadero E/R Studio
  • Knowledge of Business Intelligence tools such as ELK/Kibana, Tableau, Splunk, AWS Big Data Services such as EMR, Kinesis and Open Source Apache Big Data tools such as Hadoop, Hive, Spark and Kafka are highly desirable
  • Knowledge PostgreSQL and Cloud Relational Database Services such as AWS Aurora and RDS are highly desirable
  • Knowledge of NoSQL Data Bases such as AWS DynamoDB is highly desirable
  • Knowledge of Data Science and Data Transformation Automation frameworks such as Alteryx, UIPath, Talend ETL are highly desirable

About Signature Consultants, LLC

Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 14th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit www.sigconsult.com. Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.

EEO Employer

Signature Consultants is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Signature will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or 888.838.1020.