Data Engineer

Your role will also involve implementing Azure data architectures and environments and collaborating within a project team to solve complex problems.

• Develop and architect new data pipelines to handle large amounts of data
• Enhance and optimize current data pipelines and data architecture to meet emerging data and analytic needs
• Troubleshoot and resolve issues and bottlenecks within the current data architecture
• Implement and design Azure data architectures and environments, optimizing applications for Azure when necessary
• Collaborate within a project team environment to solve complex problems, contributing to project success
• Utilize Azure services for data migration and data processing, including Serverless Architecture, Azure Storage, Azure SQL DB/DW, Data Factory, and more
• Maintain familiarity with the technology stack available for data management, data ingestion, capture, processing, and curation
• Work with cloud migration methodologies and processes, including tools like Azure Data Factory, Event Hub, etc.
• Display a strong knowledge of private and public cloud architectures, their pros/cons, and migration considerations.
• Contribute to a team-oriented environment, fostering creativity and problem-solving skills. • Minimum of 7 years of experience as a Data Engineer or in a similar role
• Proficiency in Apache Kafka, Apache Pig, and Apache Spark
• Extensive experience with Cloud Technologies
• Strong skills in Data Visualization and Algorithm Implementation
• Proven experience in Analytics and Apache Hadoop
• Strong knowledge in API Development
• Familiarity with AWS Technologies
• Experience with Azure Data Factory, Azure Data Lake, and Azure Databricks
• Strong problem-solving skills and ability to adapt to new technologies
• Excellent communication and collaboration skills