Job Description
JOB PURPOSE:
Designing & Development of Data Pipelines in Informatica BDM and Azure Cloud
KEY ACCOUNTABILITIES:
• Requirement Gathering and planning for New Business requirements and designing data pipelines in Informatica DEI.
• Creating efficient data workflows to extract data from various sources, transform it into a usable format, and load it into target systems in Big Data Hadoop Ecosystem and its platforms.
• Creating and managing ETL processes using Informatica DEI or similar tools to extract, transform, and load data from various sources.
• Development of mappings, workflows and application for project requirements in Informatica DEI in lower env and deploying them in Production post business sign-offs.
• Responsible to debug production issues post production deployment.
• Very well verse in Hadoop and Bigdata ecosystem and scripting to design efficient data pipelines to complex Business requirements.
• Documentation: Documenting the entire data flow processes, including workflows, configurations, and any customizations created for New projects for hand-over to Production Support team.
• Implementing data quality checks, audits and governance policies to ensure data accuracy, consistency, and security.
• Must have Unix scripting Knowledge.
• Collaboration: Work closely with other ETL developers, Production Support Team, Data Architects, and Business Analysts to ensure alignment and Required support.
RequirementsQUALIFICATIONS & EXPERIENCE:
• Graduation(BE/Btech) with 5-7 Years
• Must have Minimum 5 + years of exp in Informatica Data Engineering tool in Hadoop environment and Big Data Ecosystem.
• Must have Minimum 5+ years of experience in designing Data Pipeline in Azure Cloud Data Lake and Informatica Data Engineering.
• Must have a understanding of Azure Stack (Azure Data Bricks, Azure streaming Analytics & Azure Synapse)
• Must Have Unix knowledge for writing shell scripts and troubleshoot of existing shell scripts.
• Experience in any programming language like Python/Scala.
• Must have SQL knowledge of writing & tuning complex query/script in RDBMS/Hive.
• Understanding of informatica components/services/Repository.
• Good understanding of informatica different type of connectors
• Experience in Financial & Banking domain will added advantage.
