Lead Data Engineer - Azure Data Architecture - REMOTE
Anywhere, USA · Information Technology
TITLE: Lead Data Engineer (Azure Data Lakes) LOCATION: Bedminster, NJ or Overland Park, KS or Remote TERMS: Direct Hire / Perm OPENINGS: 1 Data Engineer – 2-5 years SALARY: $110 - 135K depending on experience level STATUS: W2 Exempt TECHNOLOGIES: Microsoft Business Intelligence Stack, SSIS, SSRS, SSAS, Azure DevOps, Azure Data Factory, Azure Data Lake, Azure Data Warehouse, Cloud Data Tools (i.e., Snowflake, Azure Synapse, AWS Redshift), ETL Tools (i.e., Fivetran or DBT) SQL Objects, T-SQL, SQL Querying INTERVIEW PROCESS:Zoom with 2 Dev Managers for Technical Interview / Zoom for Cultural Interview The Lead Data Engineer should be able to,
Design, develop and implement scalable batch/real time data pipelines (ETLs) to integrate data from a variety of sources into Data Warehouse and Data Lake
Design and implement data model changes that align with warehouse dimensional modeling standards.
Proficient in Data Lake, Data Warehouse Concepts and Dimensional Data Model.
Responsible for maintenance and support of all database environments, design and develop data pipelines, workflow, ETL solutions on both on-prem and cloud-based environments.
Design and develop SQL stored procedures, functions, views, and triggers
Design, code, test, document and troubleshoot deliverables
Collaborate with others to test and resolve issues with deliverables
Maintain awareness of and ensure adherence to Zelis standards regarding privacy.
Create and maintain Design documents, Source to Target mappings, unit test cases, data seeding.
Ability to perform Data Analysis and Data Quality tests and create audit for the ETLs.
Perform Continuous Integration and deployment using Azure Devops and Git
Strong Experience designing and implementing Data Warehouse.
Experience working with Microsoft BI stack (SSIS/SSRS/SSAS) and Microsoft SQL server. (5 Years)
Must have Experience with at least one Columnar MPP Cloud data warehouse (Snowflake /Azure Synapse / Redshift) (2+ years)
Working knowledge managing data in the Data Lake.
Experience in ETL tools like Fivetran and DBT. (2 Years)
Experience with Git and Azure Devops.
Experience in Agile, Jira and Confluence.
Solid understanding of programming SQL objects (procedures, triggers, views, functions) in SQL Server. Experience optimizing SQL queries a plus.
Working Knowledge of Azure Architecture, Data Lake
Advanced understanding of T-SQL, indexes, stored procedures, triggers, functions, views, etc.
Must be detail-oriented. Must work under limited supervision. Must demonstrate good analytical skills as it relates to data identification and mapping and excellent oral communication skills. Must be flexible and able to multi-task and be able to work within deadlines; must be team-oriented, but also be able to work independently.
Have Healthcare experience preferred.
Requires minimal daily supervision
Receives detailed instruction on new assignments and determines next steps with guidance
Regularly reviews goals and objectives with supervisor
Demonstrates competence in relevant job responsibilities which allows for increasing level of independence
Ability to manage and prioritize multiple tasks
Ability to work under pressure and meet deadlines
Makes logical suggestions of likely causes of problems and independently suggests solutions
Excellent organizational skills are required to prioritize responsibilities, thus completing work in a timely fashion
Outstanding ability to multiplex tasks as required
Excellent project management skills.
Attention to detail and concern for impact is essential
Must work well with others
Effectively communicates with others by giving and receiving feedback
Communicates ideas and information clearly
Must have excellent communication and presentation skills to effectively interface with the entire staff, and external representatives from the business and client communities
Covenant Consulting strives to attract, cultivate and retain exceptional talent. If you feel you are a match for the position, and are interested in a great growth opportunity, we encourage you to contact Shannon.McInnis@Covenant-Consulting.com
Covenant Consulting is a Technology Services Provider offering project-based IT consulting, IT staffing and IT recruiting services. Every partnership reflects our uncompromising commitment to quality and integrity. We have extensive experience and capabilities in project-based consulting, short and long-term staff augmentation, and permanent recruitment. We work with companies of every size, across many industries and have the flexibility to scale solutions to meet our client's specific needs.