https://bayt.page.link/86ZHWQjQf7thn8w98
Back to the job results

Lead Data Engineer-Spark, Scala & Hadoop

Today 2025/06/11
Other Business Support Services
Create a job alert for similar positions

Job Description

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.


Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.



Job Description

Visa is inviting passionate and highly energetic technology enthusiast to join our Data & AI Platform Org. Have you developed applications handling data ranging in hundreds of million records, processing them in near real-time and batch? Are you keen to understand how it moves the needle for the business?


Our Data organization develops and manages end-to-end technology solutions that create value from our enterprise data through Internal and client-focused information-based services. This role will participate in design discussions, create solutions, develop programs and ensure successful delivery of business capabilities. This role will assume technical ownership of multiple applications and create robust and scalable solutions.


The successful candidate will be a Lead Data Engineer as part of “Data as a Service” in Data & AI Platform Organization.


Visa provides a challenging environment of volume, velocity and variety that is rarely matched. Candidates looking forward to thrive in such environment are encouraged to apply.


  • Translate business requirements and source system understanding into technical solutions using open source tech stack, Big Data, Java etc.


  • Work directly with business partners to seek clarity on requirements.


  • Define solutions in terms of components, modules, and algorithms.


  • Design, develop, document, and implement new programs and subprograms, including enhancements, modifications, and corrections to existing software.


  • Create technical documentation and procedures for installation and maintenance.


  • Write unit tests covering known use cases using appropriate tools.


  • Integrate test frameworks into the development process.


  • Refactor existing solutions to make them reusable and scalable.


  • Collaborate with operations to deploy solutions.


  • Take ownership of the production deployment of code.


  • Collaborate with cross functional teams to build and launch applications, for either revenue generating or operational purposes.


  • Develop coding and design best practices.


  • Adapt quickly to new application knowledge and changes.


This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.



Qualifications

Basic Qualifications
•10+ years of relevant work experience with a Bachelor’s Degree or at least 7
years of work experience with an Advanced degree (e.g. Masters, MBA, JD,
MD) or 4 years of work experience with a PhD, OR 13+ years of relevant work
experience.

Preferred Qualifications
•Masters or bachelor degree in computer science or another technical
discipline.
•At least 12 plus years of software development experience, particularly in data
centric initiatives, with demonstrated expertise in standard development best
practices.
•Minimum 6 plus years of experience with Hadoop, including Spark, Scala, Hive,
Kafka, GO Lang.
•Need exposure to Real Time data processing.
•Good to have hands on experience in Cloud tech stack GCP, AWS or Azure.
•Expertise in object-oriented programming languages such as Java and Python.
•Experience with CI CD processes, version control and bug tracking tools.
•Experience handling very large data volumes in both low latency and batch
modes.
•Experience with the automation of job execution, validation, and comparison of
data files at the field level in a Hadoop environment.
•Experience leading a small team and being a team player.
•Strong communication skills with the ability to present complex ideas clearly
and concisely.
•Quick learner, self starter with attention to detail and depth.



Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.





You have reached your limit of 15 Job Alerts. To create a new Job Alert, delete one of your existing Job Alerts first.
Similar jobs alert created successfully. You can manage alerts in settings.
Similar jobs alert disabled successfully. You can manage alerts in settings.