Data Engineer

apartmentRobert Half placeWarren calendar_month3/6/25

We are looking for a skilled Data Engineer to join our team in Warren, New Jersey. As a Data Engineer, you will be responsible for designing and implementing data ETL frameworks for a secure Data Lake, maintaining the optimal pipeline architecture, and examining complex data to enhance its efficiency and quality.

You will also be required to work hands-on with various AWS services and write advanced SQL scripts.

Responsibilities:

Design and implement ETL frameworks for a secured Data Lake and maintain the optimal pipeline architecture
Examine complex data sets to optimize the efficiency and quality of the data and resolve any data quality issues
Collaborate with database developers to improve system and database designs
Build data applications using AWS Glue, Lake Formation, Athena, AWS Batch, AWS Lambda, Python, Linux shell, and Batch scripting
Use AWS Database services such as Redshift, RDS, DynamoDB, Aurora, etc.
Write advanced SQL scripts involving self-joins, windows function, correlated subqueries, CTE’s etc.
Utilize data management fundamentals, including concepts such as data dictionaries, data models, validation, and reporting
Leverage skills in Apache Kafka, Apache Pig, Apache Spark, Cloud Technologies, Data Visualization, Algorithm Implementation, Analytics, Apache Hadoop, API Development, and Amazon Web Services (AWS) • Proficiency in Apache Kafka, Apache Pig, and Apache Spark is a must.
Experience with Cloud Technologies is required.
Demonstrable skills in Data Visualization are needed.
Ability to implement complex algorithms effectively.
Strong background in Analytics is essential.
Familiarity with Apache Hadoop is highly desirable.
Proven experience in API Development.
Knowledge of AWS Technologies is a prerequisite.
Proficiency in Amazon Web Services (AWS) is required.

check_circleNew offer

Lead Data Engineer

apartmentRobotics technology LLCplaceBridgewater (NJ), 7 mi from Warren (NJ)

We are seeking a highly skilled Lead Data Engineer to join our global reinsurance team. This role focuses on leveraging cutting-edge technologies, including Azure and SSIS architectures, to support underwriting, claims analysis, and risk management...

business_centerHigh salary

Data Engineer II, Shopbop

apartmentAmazonplaceNew York, 26 mi from Warren (NJ)

As a Data Engineer at Shopbop team you will routinely solve complex data problems, unblocking critical projects that drive Shopbop’s Mission to be “the daily destination for style inspiration and discovery”. Wether you are optimizing analysis...

thumb_up_altRecommended

Senior Data Engineer with R

apartmentPozentplaceRaritan (NJ), 8 mi from Warren (NJ)

Job Description: At least 12 years' experience working as a data engineer with R, with an emphasis on designing, building, and running Skills in SQL, Python, ETL (Extract, transform, load), Apache Spark and Data Analysis 5 years' experience...

Best jobs you don't want to miss:

Engineer Jobs in Warren (NJ)

Engineering Jobs in Warren (NJ) 2 Urgent