Job Title:
Job Description
We are looking for an experienced Principal Data Quality Engineer to help test their Data Platform. The potential candidate must have proven expertise with ETL Testing and AWS experience to help the internal teams to build an effective and futuristic data platform. This role is essential for ensuring that Data systems meet the highest quality standards and support the organization’s strategic objectives.
Duties and Responsibilities:
• Develop, implement, and oversee data quality strategies and frameworks to ensure high standards across the organization's Data Platform.
• ETL Testing: Design and execute comprehensive ETL test plans, including test case development, data validation, and performance testing.
• Data Pipeline Management: Monitor and optimize data pipelines using AWS services like Glue, S3, Athena, MSK, SQS, Lambda, and Step Functions to ensure reliable and efficient data processing.
• Automation and Scripting: Create and maintain automated scripts and tools for data quality validation using Python to streamline testing and data integrity checks.
• Work closely with data engineers, analysts, and stakeholders to understand data requirements, identify quality issues, and propose solutions.
• Provide detailed documentation of data quality processes, methodologies, and results.
Qualifications Required:
• 10-15 years’ proven experience in Data Quality engineering or related roles.
• Extensive experience in Data Quality engineering with a strong focus on ETL testing.
• Proven experience with AWS services including Glue, S3, Athena, MSK, SQS, Lambda, and Step Functions.
• Good Experience on SQL.
• Proficiency in Python for scripting and automation tasks.
• Experience with test management tools like Azure DevOps, Zephyr etc.
• Experience working in Agile - Scrum/Kanban
• Strong analytical and problem-solving skills with the ability to handle complex data issues and requirements.
• Strong communication and collaboration skills to work effectively with cross-functional teams.
• Demonstrated ability to lead projects and mentor team members effectively.
• High attention to detail with a strong focus on accuracy and data integrity.
• Continuous learning mindset and willingness to adapt to new technologies and techniques.
has context menu
Location:
Language Requirements:
Time Type:
If you are a California resident, by submitting your information, you acknowledge that you have read and have access to the Job Applicant Privacy Notice for California Residents