Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources.
Implement real-time data streaming and batch processing solutions to support diverse business needs.
Build and optimize data storage solutions, including data lakes, data warehouses, and databases.
Ensure data systems and pipelines are scalable, secure, and performant.
Clean, transform, and prepare raw data into usable formats for analytics and machine learning.
Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions.
Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary.
Troubleshoot and resolve data-related issues, ensuring minimal downtime.
Implement and enforce data quality checks, validation processes, and monitoring mechanisms.
Collaborate with Data Governance teams to ensure data complies with organizational standards and policies.
Work closely with cross-functional teams, including Data Architects, Analysts, and Business Teams, to understand requirements and deliver data solutions.
Provide technical expertise and guidance on data engineering best practices.
Stay updated on emerging tools, technologies, and industry trends.
Evaluate and recommend technologies to enhance data engineering capabilities.
