Role Overview:We are seeking a seasoned analytical leader to join our Enterprise Data Platform team as the Capability Lead, Data Ingestion, reporting to the Enterprise Data Platform Lead. As a key leader of McAfee’s enterprise data strategy, you will be responsible for leading a team that manages ingestion on the Databricks platform. This role requires a deep understanding of:
• Data Lake ingestion processes and best practices
• ETL/ELT design
• CI/CD
• System integration tools
• Data pipeline management
This is a Remote position located in India. We are only considering candidates located in India and are not providing relocation at this time.
About the role:
- Lead the Enterprise Data Platform Ingestion team, providing strategic guidance, mentorship, and leadership
- Oversee a team of data ingestion engineers, providing code review, best practices, and adherence to platform standards
- Provide guidance for ingestion best practices from a variety of source systems and knowledge to tailor ingestion approaches on a per-system basis
- Manage, maintain, and oversee ETL/ELT pipelines on the Databricks platform
- Ensure ELT/ETL design meets required security and compliance guidelines, and ensure PII management, flagging, and risk assessment during ingestion
- Maintain ETL/ELT pipeline infrastructure and implement automated monitoring strategies
- Manage Agile sprint development cycles for the Ingestion team
- Ensure adherence to SDLC best practices
About you:
- Bring 5+ years of experience in data engineering, ingestion pipelining, and ETL/ELT
- Hold an advanced degree in computer science, engineering, statistics, or related field
- Have experience leading small, high-performing teams of data engineers
- Have hands-on experience with and understanding of the following:
- Spark/Scala
- SQL
- Python/PySpark or similar programming language
- Databricks
- ETL/ELT development, monitoring and pipelining using tools such as Apache Airflow
- Ingestion tools such as Dell Boomi
- Data quality guidelines
- CI/CD pipelines
- Agile sprint management
- Git and version control
#LI-Remote
Company OverviewMcAfee is a leader in personal security for consumers. Focused on protecting people, not just devices, McAfee consumer solutions adapt to users’ needs in an always online world, empowering them to live securely through integrated, intuitive solutions that protects their families and communities with the right security at the right moment.
Company Benefits and Perks:We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.
- Bonus Program
- Pension and Retirement Plans
- Medical, Dental and Vision Coverage
- Paid Time Off
- Paid Parental Leave
- Support for Community Involvement
We're serious about our commitment to diversity which is why McAfee prohibits discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.
