Data Engineer/ Platform Engineer - Pyramid Consulting
Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work locationKey Responsibilities: Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant data Pipelines that provides meaningful and timely insights Build the next generation Distributed Data Pipelines using programming languages like Python Be part of a group of engineers building data pipelines using big data technologies (Spark, Snowflake, AWS Big Data Services like Glue) on medium to large scale datasets Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Collaborate with digital product managers, and deliver robust cloud-based solutions.
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performanceKey Requirements and Technology Experience: Data Engineer Platform Engineer Python Spark/ PySpark AWS (EMR, EC2, Glue, Lambda, S3, Databricks (Preferred) Platforms experience backend front end/ full stack Troubleshooting.AWS (EMR, EC2, Glue, Lambda, S3), Spark, Python, Databricks 3+ years of experience in application development including Python, SQL 2+ years of experience with a public cloud (AWS) 3+ years experience with Distributed data computing tools (Spark) 3+ years of experience with UNIX/Linux including basic commands and shell scripting 2+ years of experience with Agile engineering practicesOur client is a leadingFinancial services Industry and we are currently interviewing to fill this and other similar contract positions.
If you are interested in this position, please apply online for immediate considerationnbsp;Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local lawswas3