Lead Engineer

Role : Senior Data Engineer

Experience : 8+ Years

Mandatory Skill: Azure + Python + Databricks/Spark+ SQL

Location: Bangalore/Hyderabad

Notice Period:  less than 30 Days

Job Description:

Skills:  Azure, Python/PySpark, SQL, Databricks

• At least 8-10 years of experience in development of data solutions using cloud platforms
• Strong programming skills in Python
• Strong SQL skills and experience writing complex yet efficient SPROCs/Functions/Views using T-SQL
• Solid understand of spark architecture and experience with performance tuning big data workloads in spark
• Building complex data transformations on both structure and semi-structured data (XML/JSON) using Pyspark & SQL
• Familiarity with Azure Databricks environment
• Good understanding of Azure cloud ecosystem; Azure data certification of DP-200/201/203 will be an advantage
• Proficient source control using GIT 
• Good understanding of Agile, DevOps and CI-CD automated deployment (e.g. Azure DevOps, Jenkins)