The Data Engineer will be responsible for designing, developing, and maintaining robust data pipelines and architectures in Azure and Databricks. The ideal candidate will have a strong background in data engineering, cloud platforms, and big data technologies.
Design and implement scalable data pipelines using Azure Data Factory, Databricks, and other Azure services.
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
Optimize and troubleshoot data workflows to ensure efficient and reliable data processing.
Implement data quality checks and validation processes to ensure data integrity.
Monitor and maintain data infrastructure, ensuring high availability and performance.
Develop and manage data models, schemas, and metadata in Databricks.
Stay updated with the latest industry trends and best practices in data engineering and cloud computing.
Expertise in Azure services, including Azure Data Factory, Azure Synapse, Azure Data Lake and Azure Storage.
Knowledge of Data Warehousing/Data Lakehouse concepts.
Proficiency in Databricks and Spark for data processing and analysis.
Strong programming skills in Python, PySpark, SQL, and familiarity with ETL processes.
Excellent problem-solving skills and attention to detail.
Strong communication skills with the ability to work collaboratively in a team environment.
Location:
IND Bangalore - 1st Floor Block G4 Aspen Building, Embassy Manyata Business Park
Language Requirements:
Time Type:
Full time
If you are a California resident, by submitting your information, you acknowledge that you have read and have access to the Job Applicant Privacy Notice for California Residents
