Job Description
Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance the efficiency of our analytical capabilities.
Key Responsibilities:
- Design, develop, and maintain scalable data processing systems and data pipelines to facilitate the collection, storage, and analysis of large data sets.
- Collaborate with data scientists, analysts, and other engineers to understand data requirements and architecture needs, and to ensure data is accessible and reliable.
- Optimize data storage and retrieval performance while ensuring data integrity and security.
- Implement ETL (Extract, Transform, Terraform, Load) processes and automate data workflows to improve efficiency and accuracy.
- Monitor and troubleshoot data pipeline performance, addressing issues as they arise to minimize downtime.
- Maintain documentation for the data architecture, processes, and workflows to ensure smooth collaboration and knowledge transfer within the team.
- Stay updated on emerging technologies and best practices in data engineering and contribute to the continuous improvement of data processes and systems.