Senior Data Engineer

Company: Margin5 Solutions Inc
Location: Chicago
Posted on: May 16, 2022

Job Description:

Job Description: Data Programmer/Engineer



Project Overview: Assist with development data pipelines using Airflow & Python for large scale data warehouse project



Contractor's Role:

Will be responsible for designing & developing data pipelines using Python & Airflow.



Experience Level: 8-10 years



Requirements:

Proven experience with building data pipelines using python --- Proven experience using Airflow to build data pipelines --- Strong experience with building ETL processes, data transformation & processing --- Problem solving / analytical thinking and skills --- Teamwork and collaboration



Nice to Haves:

Experience using Snowflake





Tasks & responsibilities:

Apply data management and architecture expertise in developing solution architecture and advanced analytics solution design, including reporting technology; Articulate tradeoffs, strengths, and weaknesses of various architectures and their components to determine the best design given use cases and constraints, --- Identify internal and external data sources for potential integration into platform; Lead data migration and integration projects, --- Create appropriate standards and processes to ensure quality and consistency of data in the platform, --- Outline best practices and establish standards for data strategy, data lifecycle, data ownership, data definition, and data classification, --- Collaborate with stakeholders and advanced analytics business partners to understand business needs and to identify and define advanced analytics solutions

Keywords: Margin5 Solutions Inc, Chicago , Senior Data Engineer, Engineering , Chicago, Illinois