Data Engineer

Overview:

Role and Responsibilities

The Data Engineer will focus on loading data from various sources into the Data Lake and/or Data Warehouse as well as building and maintaining data pipelines.

Responsibilities:

• Profile and analyze data from multiple sources and data types
• Build ETL/ELT pipelines to ingest and load data
• Maintain and monitor data pipelines and schedules
• Triage and troubleshoot data quality issues and implement corrective actions
• Build and maintain data transformations
• Build and standardize reporting objects, data, and logic at the database layer
• Follow best practices for development, QA, deployment, source code management
• Ensure proper documentation is maintained, and provide walk-through of definitions and metrics
• Coordinate closely with other developers to streamline processes and optimize
• Gain strong knowledge of underlying data and business rules, and assist other teams
• Adopt agile methodology, and assist in tracking and communicating progress of deliverables
• Identify improvement opportunities (proactive and reactive)
• Build and maintain strong relationships with business and IT users, both, onshore and offshore

Qualifications:

• 4+ years working as a data engineer or data analyst
• 4+ years working with SQL Server or other relational databases, building data pipelines using ETL tools like ADF, Airbyte, Informatica, etc.
• 4+ years building objects in a SQL database, including tables, stored procedures, and views
• Expertise in SQL and data analysis
• Experience with Healthcare or Financial data preferred
• Strong ability to quickly understand data relationships and analyze
• Demonstrated ability in meeting deadlines and communicating progress across projects
• Ability to coordinate and collaborate with other team members and business owners
• Excellent communication, organization and time management skills
• Bachelor’s degree or higher

• Exposure to cloud data systems (Snowflake) and modern ELT tools (DBT) preferred