Data Integration Engineer

apartmentIntone Networks placeMclean calendar_month9/30/24

ROLE:Data Integration Engineer LOCATION: McLean,VA-Onsite JD: Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions Implement ETL processes to extract, transform, and load data from various sources Ensure data quality, integrity, and consistency throughout the ETL pipeline Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices Integrate data from different systems and sources to provide a unified view for analytical purposes Collaborate with data analysts to implement solutions that meet their data integration needs Design and implement streaming workflows using PySpark Streaming or other relevant technologies Develop batch processing workflows for large-scale data processing and analysis Year of exp:4-7 years

thumb_up_altRecommended

Senior Integration Engineer

placeMclean (TX)

passionate about creating solutions that are impactful, practical, scalable, and most importantly, that meet our clients’ ever-changing needs. As a Senior Integration Engineer, you will work with our growing DevSecOps practice developing APIs and integration...

business_centerHigh salary

Restaurant Manager

placeMclean (TX)

Brand : Brand Logo: About US: Wildfire - reminiscent of a 1940's supper club - features classics like the signature crusted steak, salads and oven roasted seafood as well as martini flights, an extensive wine list and hand-crafted...

starFeatured

Tysons Galleria - Part Time Sales Associate

apartmentRhone Apparel, Inc.placeMclean (TX)

with Company matching (limited) Other details: • Primary location: Tysons Galleria, McLean, VA • Reports to: Store Manager Rhone Apparel, Inc is an equal-opportunity employer and is committed to providing a workplace free from harassment and discrimination...