Job Description
We are looking for an experienced data engineer responsible for expanding and optimizing our big data pipelines. You will be working alongside other engineers and developers working on different layers of the data warehouse. Therefore, a commitment to collaborative problem solving, sophisticated design, and the creation of quality products is essential.
Responsibilities:
- Work closely with key partners across the ads organisation, contributing to the
- improvement of many different pipelines and services
- Build new distributed data pipelines across the organisation experience
- Use best practices in continuous integration and delivery
- Help drive optimisation, testing and tooling to improve reliability and data quality
- Apply a Data-centric approach to all the platforms, pipelines and engineering activities
- Jump into data pipelines, identify issues, and propose solutions across teams
- Work in cross-functional agile teams to continuously experiment, iterate and deliver on new product objectives
Requirements :
- 4+ years of hands-on experience working as a date engineer
- Bachelor’s degree in computer science or related discipline
- Must have hands-on experience with BigQuery, dbt, metabase, Airbyte, MongoDB
- You have a strong understanding of data systems
- You are knowledgeable and passionate about improving and building new distributed data pipelines
- You are knowledgeable about data modeling, data access, and data storage techniques
- You are familiar with current engineering practices such as distributed architecture, and are curious about new technologies that help derive insights and value from data
- You have experience working on and building distributed data pipelines that ingest huge amounts of data across multiple sources and brands
- You are very comfortable working with datasets in SQL
- You are comfortable in at least one core language like Python, Java or Scala
- You have experience working with Apache Beam, Hadoop or a similar streaming data technology
- You have experience with AWS (preferred) or GCP
- You enjoy close collaboration with backend and ML engineers and are passionate about software architecture across the stack
We have an amazing team of 700+ individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS),ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM) and ISO 14001:2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/
