Data Engineer - ADB & Synapse

Job Summary
• This role is responsible for designing, developing, testing, and maintaining software applications that cater to specific user needs or business requirements. The role plans, executes, and monitors software development projects, ensuring they are delivered on time, within budget, and according to quality standards. The role identifies potential risks and challenges in software projects and implement strategies to mitigate these risks for successful project outcomes.

Responsibilities
• Oversees the software application development projects and team of junior developers.
• Allocates resources to complete programming projects, and designing detailed plans to ensure applications are functioning properly.
• Provides technical support for the development and implementation of applications dealing with complex high-performance computing systems.
• Defines and documents product requirements, user stories, and epics and works closely with the agile team to execute on the product backlog.
• Leads multiple project teams of other software applications engineers and internal and outsourced development partners responsible for all stages of design and development for complex products and platforms, including solution design, analysis, coding, testing, and integration.
• Manages and expands relationships with internal and outsourced development partners on software applications design and development.
• Reviews and evaluates designs and project activities for compliance with applications design and development guidelines and standards; provides tangible feedback to improve product quality and mitigate failure risk.
• Provides domain-specific expertise and overall software applications leadership and perspective to cross-organization projects, programs, and activities.
• Drives innovation and integration of new technologies into projects and activities in the software applications design organization.
• Provides guidance and mentoring to less- experienced staff members.
Education & Experience Recommended
• Four-year or Graduate Degree in Computer Science, Information Systems, or any other related discipline or commensurate work experience or demonstrated competence.
• Typically has 6-12 years of work experience, preferably in applications engineering, programming, or a related field.
Preferred Certifications
• Microsoft Azure Certification (Data Fundamentals, AI Fundamentals, Databricks, Data Engineer, Data Analyst, DevOps)
Knowledge & Skills

• Full Stack Development

• Microsoft Azure

Data Bricks

• Must have over 6+ Years of experience in implementations using Microsoft Technologies with core skillset on Azure ADB
• Experience in building ETL / data warehouse transformation processes
• Direct experience of building data pipelines using Azure Data Factory and Apache Spark using Databricks.
• Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
• Coding complex U-SQL, Spark (Scala or Python). T-SQL
• Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
• Evaluating the performance and applicability of multiple tools against customer requirements

Azure ADF/Synapse - Senior Developer

• Must have around 6-10 Years of experience in implementations using Microsoft Technologies with core skillset on Azure ADF and Synapse ETL/ELT
• Must have hands on experience in developing complex ADF/Synapse Pipelines for ETL/ELT Scenarios.
• Must have minimum of 2 years of hands-on experience on SQL Server Programming, T-SQL, Stored Procedures and Triggers.
• Must have good exposure in troubleshooting the ADF pipelines.
• Experience in building CI/CD pipelines in Data environments using Azure.
• Experience in Visualization tools like PowerBI or Thoughtspot is a plus

• Application Programming Interface (API)

• Python (Programming Language)
• SQL (Programming Language)

• Agile Methodology
• Automation
• Software Development
• Software Engineering
Cross-Org Skills
• Effective Communication
• Results Orientation
• Learning Agility
• Digital Fluency
• Customer Centricity
Impact & Scope
• Impacts function and leads and/or provides expertise to functional project teams and may participate in cross-functional initiatives.
Complexity
• Works on complex problems where analysis of situations or data requires an in-depth evaluation of multiple factors.
Disclaimer
• This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, skills, responsibilities, knowledge, etc. These may be subject to change and additional functions may be assigned as needed by management.