The mission of the Shopping Core Foundations Human In the Loop (HITL) team is to build tools and capabilities used across Shopping teams to annotate data for LLM and Shopping ML models. We enable model builders to source the data they need to build, evaluate and improve their models.
Key job responsibilities
The Shopping Core Foundations team seeks a talented Software Development Engineer to lead our Root Cause Analysis (RCA) initiative. This greenfield project aims to revolutionize how we analyze and improve machine learning models across Search, Rufus/GenAI, and Alexa Shopping.
You'll develop a cutting-edge RCA system that transforms issue identification and resolution in our complex systems, directly impacting customer experience. This role requires deep understanding of large-scale systems and ML models, with opportunities to integrate the tool with backend systems and ML models.
Based in India, you'll work closely with the tool's primary users, offering a unique chance to observe its application and drive continuous improvements. Your customer obsession will be crucial in enhancing the tool to empower operations teams to generate actionable insights for model and CX improvements.
Your work will have far-reaching impact across multiple business lines and new CX developments. You'll simplify complex processes, making them more user-friendly and efficient, contributing significantly to the evolution of our shopping platforms.
Join us in building a tool that will be central to our continuous improvement efforts, driving innovation and excellence in our global shopping experiences.
A day in the life
Contribute to the design and implementation of scalable solutions for data selection, RCA-specific data labeling, analysis, and corrective action stages of the RCA process.
Collaborate with cross-functional teams including a large annotation team, shopping domain teams, product managers, and ML scientists to understand their needs and implement effective solutions.
Develop and maintain components of the RCA tool, including both frontend and backend systems.
Optimize data processing workflows to reduce time and complexity in the RCA process.
Write clean, maintainable code and contribute to the team's technical documentation.
Participate in code reviews and support continuous improvement of development practices.
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Experience with developing user interfaces for data analysis tools.
- Familiarity with machine learning concepts and their application in data analysis.