[ref. b64279520] Robert Half - Data Engineer

We are seeking a Data Engineer to join our team based in Bethesda, Maryland. As part of our Investment Management team, you will play a crucial role in designing and maintaining data pipelines in our Azure Data Lake, implementing data warehousing strategies, and collaborating with various teams to address data engineering needs.

Responsibilities:

• Design robust data pipelines within Azure Data Lake to support our investment management operations.
• Implement effective data warehousing strategies that ensure efficient storage and retrieval of data.
• Collaborate with Power BI developers to integrate data reporting seamlessly and effectively.
• Conduct data validation and audits to uphold the accuracy and quality of our data pipelines.
• Troubleshoot pipeline processes and optimize them for improved performance.
• Work cross-functionally with different teams to address and fulfill data engineering needs with a focus on scalability and reliability.
• Utilize Apache Kafka, Apache Pig, Apache Spark, and other cloud technologies for efficient data visualization and algorithm implementation.
• Develop APIs and use AWS technologies to ensure seamless data flow and analytics.
• Leverage Apache Hadoop for effective data management and analytics. • Proficiency in Apache Kafka, Apache Pig, and Apache Spark for managing and processing data streams.
• Extensive knowledge of cloud technologies, with a focus on data storage and management.
• Demonstrated ability in data visualization to effectively communicate data insights.
• Experience with algorithm implementation, particularly in the context of data processing.
• Strong analytics skills, with the ability to interpret complex data sets and derive meaningful insights.
• Expertise in Apache Hadoop for large-scale data processing.
• Proven experience in API development, with a focus on data retrieval and integration.
• Familiarity with AWS technologies, particularly those related to data storage and processing.