Job Description
Role : Senior Data Engineer
Experience : 8+ Years
Mandatory Skill: Azure + Python + Databricks/Spark+ SQL
Location: Bangalore/Hyderabad
Notice Period: less than 30 Days
Job Description:
Skills: Azure, Python/PySpark, SQL, Databricks
- At least 8-10 years of experience in development of data solutions using cloud platforms
- Strong programming skills in Python
- Strong SQL skills and experience writing complex yet efficient SPROCs/Functions/Views using T-SQL
- Solid understand of spark architecture and experience with performance tuning big data workloads in spark
- Building complex data transformations on both structure and semi-structured data (XML/JSON) using Pyspark & SQL
- Familiarity with Azure Databricks environment
- Good understanding of Azure cloud ecosystem; Azure data certification of DP-200/201/203 will be an advantage
- Proficient source control using GIT
- Good understanding of Agile, DevOps and CI-CD automated deployment (e.g. Azure DevOps, Jenkins)
