Big Data Engineer
Startekk LLC Malvern
Note:
Location: Malvern, PA (Onsite)
C2C: Yes
Duration: 12 Months
Primary Skills: AWS Cloud Formation,Python,SQL
Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy
Understanding of data pipelines, ETL processes, and data warehousing concepts
Strong experience in building and orchestrating data pipelines
Experience in building APIs
Experience in designing and building web environments on AWS
Write, maintain, and execute automated unit tests using Python
Follow Test-Driven Development (TDD) practices in all stages of software development
Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC
Proficiency in developing serverless architectures using AWS services
Experience with both relational and NoSQL databases
Skills in designing and implementing data models, including normalization, denormalization, and schema design
Knowledge of data warehousing solutions like Amazon Redshift
Strong analytical skills with the ability to troubleshoot data issues
Good understanding of source control, unit testing, test-driven development, and CI/CD
Ability to write clean, maintainable code and comprehend code written by others
Strong communication skills
Knowledge of trading and investment data
Location: Malvern, PA (Onsite)
C2C: Yes
Duration: 12 Months
Primary Skills: AWS Cloud Formation,Python,SQL
Visa: H4EAD, green card or citizens preferred
Job Description
Vanguards Trading Analytics & Strategy (TAS) team leverages data, execution technology, and research to advance vanguards trading strategies, empowering traders to achieve the lowest trading costs, unmatched efficiency, and increased competitiveness.
As an Engineer on the full stack team, you will be expected to help design, implement, and maintain a modern, robust, and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.
Qualifications: Proficiency in Python programming Strong expertise in SQL, Presto, HIVE, and Spark
Experience in big data technologies such as Spark and developing distributed computing applications using PySparkExperience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy
Understanding of data pipelines, ETL processes, and data warehousing concepts
Strong experience in building and orchestrating data pipelines
Experience in building APIs
Experience in designing and building web environments on AWS
Write, maintain, and execute automated unit tests using Python
Follow Test-Driven Development (TDD) practices in all stages of software development
Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC
Proficiency in developing serverless architectures using AWS services
Experience with both relational and NoSQL databases
Skills in designing and implementing data models, including normalization, denormalization, and schema design
Knowledge of data warehousing solutions like Amazon Redshift
Strong analytical skills with the ability to troubleshoot data issues
Good understanding of source control, unit testing, test-driven development, and CI/CD
Ability to write clean, maintainable code and comprehend code written by others
Strong communication skills
Knowledge of trading and investment data
Experience with OneTick / KDB
Marsh McLennanConshohocken, 12 mi from Malvern (PA)
The Data Engineer will be responsible for designing and building systems for collecting, cleaning, analyzing, storing, and interpreting data to solve problems and answer questions. This role requires strong technical skills, attention to detail...
PfizerCollegeville (PA), 11 mi from Malvern (PA)
product development and for all Pfizer countries. One of the team's top priorities is the development of an enterprise data lake which will serve as the engine for the company's digital transformation.
Pfizer is seeking a Data Engineer to help...
Robert HalfWyomissing, 32 mi from Malvern (PA)
We are offering a short-term contract employment opportunity for a Data Engineer in Wyomissing, Pennsylvania. The role primarily involves working with Snowflake and Talend, with a focus on the development and design of tables within Snowflake...