Title: Data Engineer with Kusto - Onsite - locals
Location: Redmond, WA, USA
Length: Long term
Restriction: W2 or C2C
Description:
Webcam interview *** Long term project *** *** Onsite ***
*** Need local Candidates to WA Only ***
Job Description:
10 years of experience Microsoft experience is a MUST with last 3/4 years Should have experience in using Pyspark.Working experience on KUSTO for telemetry data Should be able to write python code in Azure Synapse Notebook. Good understanding working experience of Azure Synapse end to end. Should have experience in working with Spark structured streaming data possibly from Event hubs
Should have experience in handing large volume of data possibly in 100s of GBShould be able to debug and fine tune the jobs note book for optimum memory consumption and processing.
Should have knowledge of Data warehousing, data management for efficient data handling. Should have good knowledge of data modeling data engineering work.
Experience working with large data sets using SQLAzure Data LakePySparkADFSynapse, etc., to derive actionable insights is highly desirable.
They should be productive soonest possible post joining.
Microsoft ecosystem knowledge.
Azure DevOps
Azure WebApps functions
Azure Cosmos Dbeventhub
To be responsible for providing technical guidance or solutions define, advocate, and implement best practices and coding standards for the team.
To develop and guide the team members in enhancing their technical capabilities and increasing productivity
To ensure process compliance in the assigned module, and participate in technical discussions or review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
To prepare and submit status reports for minimizing exposure and risks on the project or closure of escalations.