Data Engineer

As a Data Engineer, you will be collaborating with data analysts, data scientists, and other stakeholders to assure data accessibility, accuracy, and reliability for business decisions and insights.

Responsibilities:

• Design, build and maintain scalable ETL/ELT pipelines to process both structured and unstructured data.
• Collaborate with data scientists and analysts to understand data needs and provide appropriate solutions.
• Integrate data from multiple sources into data warehouses, lakes or other storage systems.
• Develop and maintain data models that support analytics and reporting needs.
• Ensure data integrity, consistency, and accuracy through quality checks and validation processes.
• Implement data architecture best practices for high availability and performance.
• Monitor and optimize the performance of data systems and pipelines.
• Work with stakeholders to establish and enforce data governance policies.
• Troubleshoot and resolve issues related to data processing and storage.
• Provide technical support and documentation for data systems and processes
• Minimum of 3 years of experience as a Data Engineer or in a similar role
• Proficiency in Apache Kafka, Apache Pig, and Apache Spark is mandatory
• Demonstrable experience in Data Visualization and Algorithm Implementation
• Strong analytical skills with a data-oriented mindset
• Extensive knowledge of Apache Hadoop is required
• Experience in API Development is highly beneficial
• Proven ability to work independently as well as collaboratively in a team environment
• Bachelor's degree in Computer Science or a related field (or equivalent work experience) is preferred
• Excellent communication skills, both written and verbal
• Demonstrable problem-solving abilities with a keen attention to detail
• Ability to manage multiple tasks and projects simultaneously in a fast-paced environment.