Lead Software Engineer - ETL Engineer

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Lead Software Engineer at JPMorgan Chase within the Securities Services Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.

Job responsibilities

• Design, develop, and maintain ETL processes to support data integration and data warehousing solutions.
• Collaborate with data architects, data analysts, and business stakeholders to understand data requirements and translate them into technical specifications.
• Optimize and tune ETL processes for performance and scalability.
• Ensure data quality and integrity through rigorous testing and validation procedures.
• Monitor and troubleshoot ETL processes to resolve issues and ensure timely data availability.
• Develop and maintain documentation for ETL processes, data flows, and data models.
• Mentor and provide guidance to junior ETL engineers and data team members.
• Stay current with industry trends and best practices in data engineering and ETL technologies.

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 5+ years of applied experience
• Hands-on practical experience in ETL development and data engineering
• Strong experience with Apache Spark and Python
• Strong SQL skills and experience with relational databases (e.g., Oracle, SQL Server, MySQL)
• Good Debugging and Optimization Capabilities
• Understanding of different data formats like CSV, Parquet and ORC and data sources like HDFS, S3, SFTP, Apache Iceberg etc
• Proficient in all aspects of the Software Development Life Cycle
• Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
• Familiarity with other programming languages such as Java or Scala
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services

• Experience with big data technologies (e.g., Hadoop).
• Knowledge of data governance and data security best practices.
• Experience with real-time data processing and streaming technologies (e.g., Kafka, Flink).