Hadoop Administrator - Bangalore/ Pune- 7-12Years
Are you curious, motivated, and forward-thinking? At FIS you’ll have the opportunity to work on some of the most challenging and relevant issues in financial services and technology. Our talented people empower us, and we believe in being part of a team that is open, collaborative, entrepreneurial, passionate and above all fun.
What You Will Be Doing:
Service Management: Administer, configure, and maintain Hadoop ecosystem services within both Cloudera Data Platform (CDP) and Cloudera Distributed Hadoop (CDH), including HDFS, YARN, Hive, Spark, Ranger, Sentry, Kerberos security, KMS, KTS, Zookeeper, and more.
Job Scheduling and Workflow Management: Utilize Oozie, Zena, Airflow to schedule and orchestrate complex data jobs and workflows, meeting business requirements efficiently. This includes day-end SLA jobs to ensure timely data processing.
Security and Access Control: Manage security measures such as Kerberos authentication, safeguarding Hadoop clusters and data in both CDP and CDH environments. Implement and maintain role-based access control (RBAC) policies in Ranger and Sentry.
Job Monitoring and Tuning: Set up robust monitoring systems, including advanced tools like Unravel, to track cluster health, job execution, and resource utilization in both CDP and CDH environments. Continuously fine-tune configurations for optimized performance.
Issue Resolution and Troubleshooting: Identify and troubleshoot issues related to job failures, data processing, and cluster performance in both CDP and CDH environments. Develop and implement solutions to mitigate recurring problems.
Cross-Functional Collaboration: Act as a bridge between technical teams, including application support, development, and scheduling. Facilitate effective communication to understand and address their requirements and issues.
What You Will Bring:
Bachelor's degree in computer science, information technology, or a related field (Master's preferred).
Proven experience as a Hadoop Administrator and Big Data Engineer, with expertise in managing a wide range of Hadoop ecosystem services across CDP and CDH environments, including day-end SLA jobs.
Deep understanding of security practices, including Kerberos, Ranger, and Sentry, in both CDP and CDH.
Proficiency in job scheduling and orchestration using Zena, Oozie, and Airflow across both environments.
Strong scripting skills (e.g., Bash, Python) and experience with automation frameworks.
Excellent problem-solving and troubleshooting abilities.
Familiarity with advanced monitoring tools like Unravel.
Relevant certifications (e.g., Cloudera Certified Administrator, AWS Certified Big Data) are advantageous.
What We Offer You:
An exciting opportunity be a part of World’s Leading FinTech Product MNC
To be a part of vibrant team and to build up a career on core banking/payments domain
A multifaceted job with a high degree of responsibility and a broad spectrum of opportunities
A broad range of professional education and personal development possibilities – FIS is your final career step!
Privacy Statement
FIS is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how FIS protects personal information online, please see the Online Privacy Notice.
Sourcing Model
Recruitment at FIS works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. FIS does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company.
#pridepass