Enterprise Technology Engineer

Job Family Group:

IT&S Group

Job Description:

Digital Trading Analytics: Enterprise Technology Engineer

• Design, develop, and implement data pipelines using Python (Pandas), SQL, and Apache Airflow.
• Extract, transform, and load (ETL) data from various sources including web APIs, databases, and flat files.
• Leverage AWS services like S3, Redshift, and EC2 to build and deploy data pipelines in the cloud.
• Optimize and solve data pipelines for performance and efficiency.
• Write unit and integration tests to ensure data quality and pipeline integrity.
• Apply Databricks for large-scale data processing tasks.
• Build data visualizations to communicate insights to technical and non-technical audiences.
• Collaborate with traders, trading analysts, business analysts and fellow engineers to ensure data pipelines meet business needs.
• Work in an Agile environment (Kanban/Scrum) using Azure Dev Ops for planning, tracking, and handling work.
• Document data pipelines and procedures for maintainability and knowledge transfer.

ESSENTIAL EDUCATION-

Bachelor’s or master's degree or equivalent experience in computer science, engineering, information systems or a numerate degree!!!

EXPERIENCE-

Minimum 3 years of experience as a Data Engineer or related role.

Proven experience with Python (Pandas, Webscraping libraries like Selenium, Beautiful Soup, and Requests).

Strong proficiency in SQL and experience with relational databases.

Solid grasp of ETL processes and data pipeline design principles.

Experience with Apache Airflow for data orchestration and scheduling.

Experience with AWS cloud services (S3, EC2, EKS) is a plus.

Experience with Databricks is a plus.

Experience with data visualization tools (e.g., Tableau, Power BI) is a plus.

Experience working in a Linux environment.

Familiarity with Git version control.

Excellent written and verbal communication skills.

Ability to work optimally in a team environment and collaborate with diverse customers.

Strong analytical and problem-solving skills.

A passion for automation and building robust, efficient solutions.

Highly responsible, determined and able to thrive in an upbeat, fast paced, high growth environment; exhibits ownership of tasks assigned.

Good teammate with a customer service orientation with the ability to forge relationships at all levels of the company and across diverse cultures

Excellent organizational skills required to adapt to a constantly evolving technical environment

Good Understanding of the following:

Agile Core Practices

Configuration management and release

Documentation and knowledge sharing

Information Security Standards

Source control and code

Testing and Quality

Travel Requirement:

Up to 10% travel should be expected with this role

Relocation Assistance:

This role is eligible for relocation within country

Remote Type:

This position is a hybrid of office/remote working

Skills:

Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving

​
Legal Disclaimer:

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.
If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.