Job Description
Job Title:
Azure Data Engineer
Job Description
The Data Engineer will be responsible for designing, developing, and maintaining robust data pipelines and architectures in Azure and Databricks. The ideal candidate will have a strong background in data engineering, cloud platforms, and big data technologies.
- Design and implement scalable data pipelines using Azure Data Factory, Databricks, and other Azure services.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
- Optimize and troubleshoot data workflows to ensure efficient and reliable data processing.
- Implement data quality checks and validation processes to ensure data integrity.
- Monitor and maintain data infrastructure, ensuring high availability and performance.
- Develop and manage data models, schemas, and metadata in Databricks.
- Stay updated with the latest industry trends and best practices in data engineering and cloud computing.
- Expertise in Azure services, including Azure Data Factory, Azure Synapse, Azure Data Lake and Azure Storage.
- Knowledge of Data Warehousing/Data Lakehouse concepts.
- Proficiency in Databricks and Spark for data processing and analysis.
- Strong programming skills in Python, PySpark, SQL, and familiarity with ETL processes.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills with the ability to work collaboratively in a team environment.
Location:
IND Bangalore - 1st Floor Block G4 Aspen Building, Embassy Manyata Business Park
Language Requirements:
Time Type:
Full time
If you are a California resident, by submitting your information, you acknowledge that you have read and have access to the Job Applicant Privacy Notice for California Residents
