Work with business partners to understand key business drivers and use that knowledge to experiment and transform Business Intelligence & Advanced Analytics solutions to capture the value of potential business opportunities
Improve data pipeline reliability, scalability, and security. Design, build and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements.
Translate a business process/problem into a conceptual and logical data model and proposed technical implementation plan
Work closely with the Product Owners and stake holders to design the Technical Architecture for data platform to meet the requirements of the proposed solution.
Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, NoSQL stores like Cassandra, HBase etc, Databased like Snowflake, RDS etc)
Assist in developing and implementing consistent processes for data modeling, mining, and production
Experience in architecting software solution on public cloud.
Help the Data Engineering team produce high-quality code that allows us to put solutions into production
Creating reusable and scalable data pipelines
Focus on implementing development processes and tools that allow for the collection of metadata, access to metadata, and completed in a way that allows for widespread code reuse (e.g., utilization of ETL Frameworks, Generic Metadata driven Tools, shared data dimensions, etc.) that will enable impact analysis as well as source to target tracking and reporting
