الوصف الوظيفي
Entity: TechnologyJob Family Group: IT&S GroupJob Description: Staff Data EngineerJob Profile SummaryBP is transforming and at our Digital Hub in Pune we are growing the digital expertise and solutions needed to advance the global energy transition.Are you passionate about bringing together the world of data and business to drive change? Data and Analytics are a cross-collaborative team of experts who build, integrate, manage, and maintain intelligent data products at rapid pace.We’re looking for curious minds who are excited by the opportunity to create and deliver an exciting suite of digital products and services to advance the global energy transition. You will need to solve complex business challenges whilst collaborating and co-innovating globally, backed by a culture that encourages creativity and curiosity, and a team that brings out the best in each other.Role Synopsis:We sit in the Data, Analytics & AI (DA&AI) group under Technology. One key remit of this group is to drive the transformation of the company through its use of data. A major digital sub-team within DA&AI is Data & Asset Management (DAM). DAM is responsible for all digital and data initiatives and operations across the following areas of the bp business:Production & Projects including Health, Safety, Environment & CarbonRefining & OperationsWells & SubsurfaceStrategy & SustainabilityGas & Low CarbonGeospatial“DataWorx” is the name of the data team that is responsible for all data within these areas and we are developing deep data capabilities to transform the access, supply, control and quality to our vast and ever growing data reserves that are measured in Petabytes. The DataWorx team covers many data sub-disciplines, including data science, data analytics, data engineering and data management as well as specialist areas such as geospatial, remote sensing, knowledge management and digital twin. The DataWorx team works with a wide variety of data from structured data to unstructured data & we also work on Real-time streaming data processing along with Batch data processing.Key Responsibilities:Architects, designs, implements, and maintains reliable and scalable data solutionsEstablishes metadata management, data catalogs, data lineage, data standards, data stewardship, and best practices across the organizationLeads the team to establish Data Governance model including people, process, and technology to sustain data qualityResearches and promotes new tools and techniques to shape the future of the data engineering environmentWorks closely with data scientists, micro-service developers, and security experts to build out data platform incrementally and securelyDevelops data modelling best practices and acts as a subject matter expert for data models across all areas of the businessLeads the team to write, deploy, and maintain software to build, integrate, manage, maintain, and quality-assure dataArchitects, designs, develops, and delivers large-scale data ingestion, data processing, and data transformation projects on the Azure cloudMentors and shares knowledge with the team to provide design reviews, discussions, and prototypesLeads customer discussions from a technical standpoint to deploy, manage, and audit best practices for cloud productsLeads the team to follow software & data engineering best practices (e.g., technical design and review, unit testing, monitoring, alerting, source control, code review & documentation)Leads the team to deploy secure and well-tested software that meets privacy and compliance requirements; develops, maintains, and improves CI / CD pipelineLeads the team in following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Design, build, deploy and maintain infrastructure as code. Containerizes server deployments.Actively contributes to improve developer velocityPart of a cross-disciplinary team working closely with other data engineers, software engineers, data scientists, data managers and business partners in a Scrum/Agile setupJob Requirements:Education:Bachelor or higher degree in computer science, Engineering, Information Systems, or other quantitative fieldsExperience:Years of experience: 12 to 16 years with minimum of 7 to 9 years relevant experience Deep and hands-on experience (typically 5+ years) designing, planning, productionizing, maintaining, and documenting reliable and scalable data infrastructure and data products in complex environments Deep knowledge in Data Governance, metadata management, data catalog, and data observability Hands on experience with:Databricks and using Spark for data processing (batch and/or real-time)Languages: Python, Scala, SQLCloud platforms: Azure (ideally) or AWSAzure Data Lake, Azure SQL DB, Synapse, and Cosmos DB (or equivalent cloud components)Designing data solutions incl. data distributions and partitions, scalability, cost-management, disaster recovery and high availabilityData modeling with relational or data-warehouse systemsAdvanced hands-on experience with different query languagesAzure DevOps (or similar tools) for source control & building CI/CD pipelinesUnderstanding Data Structures & Algorithms & their performance Experience designing and implementing large-scale distributed systems Deep knowledge in technologies across all data lifecycle stages Stakeholder management and ability to lead large organizations through influenceDesirable Criteria:Strong stakeholder managementContinuous learning and improvement mindsetBoy Scout mindset to leave the system better than you found itKey Behaviors:Empathetic: Cares about our people, our community, and our planetCurious: Seeks to explore and excelCreative: Imagines the extraordinaryInclusive: Brings out the best in each otherTravel RequirementUp to 10% travel should be expected with this roleRelocation Assistance:This role is eligible for relocation within countryRemote Type:This position is a hybrid of office/remote workingSkills:Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem SolvingLegal Disclaimer:We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.
