Job Description
Job Brief:
We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in designing and implementing data pipelines, as well as experience in optimizing data workflows and handling large volumes of data. You will be responsible for developing and maintaining efficient data infrastructure, as well as collaborating with cross-functional teams to address data-related technical challenges and fulfill data infrastructure needs.
Duties and Responsibilities:
- Design and develop scalable and reliable data pipelines, ensuring high availability and performance.
- Construct intricate data sets that align with functional and non-functional business requirements.
- Identify, plan, and implement internal process enhancements, such as automation of manual processes, data delivery optimization, and infrastructure redesign for improved scalability.
- Implement best practices for data storage, processing, and retrieval.
- Collaborate with stakeholders including executives, data scientists, and product managers to understand data requirements and implement data solutions.
- Optimize and tune data workflows to achieve optimal performance and efficiency.
- Maintain data security and compliance with data privacy regulations.
- Stay up-to-date with emerging technologies and industry trends in data engineering and analytics.
- Mentor and guide more junior data engineers in the team.