Data Engineer – Data Sourcing & Solutions
Gurgaon/Bangalore, India
The Data Sourcing & Solutions team is a growing group inside of AXA XL, responsible for designing and implementing data structures that will enable AXA XL to harness the potential of advanced analytics in the decision-making process.Data is vital to analytics. To ensure that we are achieving our potential under this discipline, we need to make certain our data has the right context, granularity, and quality. The Data Engineer plays a critical role within the Data Sourcing & Solutions team as this person is responsible for designing and implementing data structures to support current and future analytical projects within.We are looking for candidates that have experience working with data from a raw, unprocessed state and organizing it in an intuitive way.Building this data pipeline enables our partners to analyze data better and faster – ultimately leading the organization in optimizing the decision-making process.
DISCOVERyour opportunity
What will your essential responsibilities include?
·Exploring and acquiring new sources of data.Using curiosity and creativity, this would involve using technology to automate data acquisition, ability to link new sources with internal data, and appropriate level of supporting documentation of the source and technical solution.
·Providing the right context of data required for a given analysis.This would require the candidate to work with data modelers/analysts to understand the business problems they are trying to solve and create data structures to feed into their analysis.
·Build upon learnings of internal and external data to become more proactive.This includes thinking ahead of what modelers will anticipate with their data needs and designing structures that are intuitive to use.
·Ensuring quality and understanding of analytical data.This would require hands on data experience to look into data issues and seek to resolution or acceptance.Create the appropriate amount of documentation, leverage standards and build upon them.Data should be reconciled and documented at various stages for integrity.
·Participate in developing governance and rigor of data management practice within the Data Sourcing & Solutions Team.This will also include partnering with enterprise IT groups and involvement in enterprise data related functions.
You will report to Data Manager-Solutions Delivery & Analytics.
SHARE your talent
We’re looking for someone who has these abilities and skills:
Required Skills and Abilities:
·Relevant years of work experience.
·Sound understanding/experience of Python, Spark, Databricks PySpark/Spark SQL and best practices.
·Outstanding SQL Skills required.
·Expertise in Star Schema data modelling.
·Expertise in the design, creation and management of large datasets/data models.
·Oustanding analytical and problem solving skills.
·Experience working on building /optimizing logical data model and data pipelines while delivering high data quality solutions that are testable and adhere to SLAs.
·Data development experience using data development / Analysis tools.
·Data Engineering and Insurance background preferred.
·Development experience using R(Data structures, Plumber, Shiny)a plus.
·Familiarity with developer support tools (TFS/GIT, Jenkins) a plus.
·Demonstrated ability to work through data complexities which includes variety of sources, formats, and structures.
Required Skills and Abilities: