• Design, develop, and maintain scalable and robust data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake.
• Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and ensure efficient data integration and data quality.
• Optimize data workflows and processes to improve data reliability, performance, and scalability.
• Implement and maintain data governance practices, ensuring data security, compliance, and privacy regulations are adhered to.
• Perform data modeling and schema design to support data analytics and reporting requirements.
• Troubleshoot and resolve issues related to data pipelines, data quality, and system performance.
• Stay up to date with industry trends and emerging technologies in data engineering and recommend innovative solutions to enhance our data infrastructure and processes.