Senior Data Engineer

For immediate consideration email Ed Vitela at Robert Half

You’ll collaborate with cross-functional teams to ensure high-quality, accessible, and reliable data solutions.

Key Responsibilities:

• Design, develop, and maintain data pipelines using SQL, Python, and Databricks to support data ingestion, transformation, and integration.
• Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and deliver high-quality data solutions.
• Develop and optimize data processing workflows and storage solutions in Azure Cloud, ensuring scalability and performance.
• Ensure data quality, consistency, and reliability by implementing automated validation and monitoring.
• Manage data lakes and warehouses, and ensure efficient data storage and retrieval within the Azure environment.
• Implement and maintain ETL (Extract, Transform, Load) processes to process large datasets and make them ready for analytics.
• Troubleshoot and resolve issues related to data pipelines, data flow, and performance optimization.
• Continuously monitor and optimize data solutions for performance, cost, and scalability.
• Document processes, architectures, and workflows to ensure clarity and maintainability of data infrastructure.

Qualifications:

• 3+ years of experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL, Python, and Databricks for data pipeline development.
• Hands-on experience with Azure Cloud services, including Azure Data Lake, Azure SQL Database, Azure Data Factory, and Azure Synapse Analytics.
• Experience with building and maintaining data pipelines, ETL/ELT processes, and working with large datasets.
• Solid understanding of data architecture principles and best practices for cloud-based solutions.
• Familiarity with data warehousing concepts and technologies (e.g., star schema, data marts).
• Strong problem-solving skills with the ability to work with cross-functional teams to resolve data issues.
• Excellent communication skills and the ability to translate technical concepts into business-friendly language.

Nice to Have:

• Experience with data visualization tools (e.g., Power BI, Tableau).
• Familiarity with big data technologies (e.g., Hadoop, Spark).
• Certifications in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate) or related technologies.

• Competitive salary and benefits package.
• Opportunity to work on cutting-edge data technologies in the cloud.
• Collaborative work environment with a focus on continuous learning and growth.

If you're passionate about working with data and cloud technologies and enjoy solving complex data challenges, we'd love to hear from you!