Lead Data Engineer

apartmentRobotics technology LLC placeBridgewater calendar_month 
We are seeking a highly skilled Lead Data Engineer to join our global reinsurance team. This role focuses on leveraging cutting-edge technologies, including Azure and SSIS architectures, to support underwriting, claims analysis, and risk management.

You will design and implement scalable data solutions, ensuring seamless data integration, availability, and security across systems and teams in a collaborative, global environment. Key Responsibilities: Design and Implement Data Solutions: Lead the design, implementation, and management of data solutions on Azure, including data pipelines, storage solutions, and data processing workflows.Data Architecture: Develop and maintain data architecture to support business requirements, ensuring scalability, performance, and Leadership: Manage and mentor a team of data engineers, providing guidance and support to ensure efficient data processes.Data Integration and ETL: Oversee the development and implementation of ETL processes to integrate data from various sources into data warehouses or data lakes or data stores.Performance Optimization:Continuously optimize data workflows, pipelines, and storage for performance, reliability, and fault tolerance.Monitor, troubleshoot, and resolve issues in data pipelines and systems proactively.Process Improvement: Identify and implement internal process improvements, such as automating manual processes and optimizing data delivery.Collaboration: Work closely with stakeholders and other teams to address data-related technical issues and support data-driven with IT and compliance teams to ensure adherence to data governance, security, and privacy (link removed)novation and AutomationEvaluate and implement modern data engineering tools and practices to enhance operational efficiency.Automate repetitive tasks to streamline processes and improve productivity.

Skills and Qualifications: Educational BackgroundBachelors or masters degree in computer science, Data Engineering, or a related field.Technical SkillsProficiency in Azure data services (e.g., Azure SQL Database, Azure Data Factory, Azure Cosmos DB, Azure Blob StorageHands-on experience with PySpark/Python, SQLStrong experience with SSIS.Solid understanding of Change Data Capture (CDC) techniques for incremental data processing.Familiarity with CI/CD tools such as DevOps.Familiarity in Data Fabric technologies and architectures and Azure data lake.Familiarity in Power BI for creating dynamic dashboards and reports.Familiarity with restful API and API integrations.Data Management: Strong knowledge of data management, data integration, and ETL processes.Leadership Skills: Proven experience in leading and managing a team of data engineers.

Ability to handle multiple tasks and meet deadlines in a dynamic environment.Analytical Skills: Excellent analytical and problem-solving skills to transform raw data into actionable (link removed)munication: Strong communication skills to effectively collaborate with stakeholders and team (link removed)dustry Knowledge Familiarity with the reinsurance/insurance domain, including risk modeling, claims analysis, and underwriting processes.

apartmentPozentplaceRaritan (NJ), 2 mi from Bridgewater (NJ)
Job Description: At least 12 years' experience working as a data engineer with R, with an emphasis on designing, building, and running Skills in SQL, Python, ETL (Extract, transform, load), Apache Spark and Data Analysis 5 years' experience...
local_fire_departmentUrgent

Data Engineer

apartmentRobert HalfplaceWarren (NJ), 7 mi from Bridgewater (NJ)
We are looking for a skilled Data Engineer to join our team in Warren, New Jersey. As a Data Engineer, you will be responsible for designing and implementing data ETL frameworks for a secure Data Lake, maintaining the optimal pipeline architecture...
electric_boltImmediate start

Data Engineer II, Shopbop

apartmentAmazonplaceNew York, 34 mi from Bridgewater (NJ)
As a Data Engineer at Shopbop team you will routinely solve complex data problems, unblocking critical projects that drive Shopbop’s Mission to be “the daily destination for style inspiration and discovery”. Wether you are optimizing analysis...