Sr. Data Engineer: Snowflake DW + Matillion + APIs (any tool) + cloud (AWS, Azure, etc) req; data streaming (any tool) is a + - Irvine
THIS JOB IS ONSITE IN IRVINE, CA.
KORE1, a nationwide provider of staffing and recruiting solutions, has an immediate opening for a Sr. Data Engineer: Snowflake DW + Matillion + APIs (any tool) + cloud (AWS, Azure, etc) req; data streaming (Kafka or similar) is a +
MAJOR RESPONSIBILITIES
To excel in this data engineering position, you should have strong programming and analytical skills to effectively combine data from various sources, including both batch and real-time streams. In this role, you will design and develop data solutions that support analytics, application development, and data science efforts.
Work closely with Data product owner and BSA to thoroughly understand the business user stories
Work with the Data Architect to accurately interpret the data modeling and design the data flow
Develop ELT data pipeline to load data from various data sources to data lake and data warehouse and apply complex business logic to populate normalized and denormalized data structure
Design and implement real-time data streaming solutions
Build reusable components for a scalable data integration methodology such as error handling, logging, and recoverability
Participate in the data modeling / schema design
Perform and support query development and optimization