Deriv.com | Full time
Data Engineer
Dubai, United Arab Emirates | Posted on 01/06/2022
{{getI18n("zr.cw.refertofrnd")}} {{getI18n('zr.careers.publicpage.meta.viewapplication')}} {{getI18n(data[0].applynow)}}
Job Description
We are the Business Intelligence team. We lead the organisation in cultivating a data-driven culture as our company moves towards the future. We collect meaningful data and analytics for us to deeply understand our consumers and build more valuable products and services. What we do is incredibly important in driving smart marketing decisions, optimising our business, and increasing profitability.
As a Data Engineer at Deriv, you will collect, manage, and convert raw data into usable information which will help us evaluate and optimise the organisation’s performance. You will develop, test, and maintain architectures for data processing and build pipelines for Extract, Transform, and Load (ETL) operations. It will be your responsibility to ensure data accuracy and enhance the quality of both existing and new data.
Your challenges
Identify and access data from multiple sources and ensure the absorption of existing and newly acquired data for future use.
Understand the organisational needs, create new data values to address those needs, convert data values into usable information, and design solutions.
Convert raw data into an easy-to-understand format for organisational use, such as analysis and reporting purposes.
Develop and maintain the organisation’s database which includes responsibilities such as design, process, analysis, and data flow optimisation.
Manage the pipelined architecture which includes responsibilities such as resolving logging errors, testing, administering databases, and ensuring a stable pipeline.
Requirements
Experience with data modelling techniques such as Kimball star schema, Anchor modelling, and Data vault
Competence in object-oriented or object function scripting languages such as Python
Quality experience in relational SQL and NoSQL databases, preferably with PostgreSQL, PITR, Pg\_basebackup, WAL archival, and Replication
Proven skills in developing and maintaining ETL/ELT data pipelines and workflow management tools such as Airflow
Analytical skills with the ability to transform data into optimal business decisions
Experience in helping teams make informed business decisions with data
Strong communication and presentation skills
Fluency in spoken and written English
What’s good to have
Good background in cybersecurity and data protection
Proficiency in using data pipeline and workflow management tools such as Luigi
Knowledge in Java
Experience with Amazon Web Services (AWS) Cloud, Google Cloud Services (GCS) such as Google Compute Engine (GCE), BigQuery, Dataflow, and Cloud functions
Benefits
Market-based salary
Annual performance bonus
Medical insurance
Housing and transportation allowance
Casual dress code
Work permit
{{getI18n('zr.careers.publicpage.meta.viewapplication')}} {{getI18n(data[0].applynow)}} {{userData.full\_name}} {{userData.role.name}}, {{userData.profile.name}}
{{getI18n("crm.sme.skill.list.head.experience")}}
{{getI18n('crm.auditlog.skillset')}} {{getI18n('crm.sme.skill.list.head.experience')}} {{getI18n('crm.sme.skill.list.head.last.used')}} {{getI18n('crm.sme.system.skill')}} {{getI18n('crm.auditlog.skillset')}} {{getI18n('zr.skillset.proficiency')}} {{getI18n('crm.sme.skill.list.head.experience')}} {{getI18n('crm.sme.skill.list.head.last.used')}} {{getI18n('zr.candidateportal.skillname.mandatory')}} {{getI18n('zr.candidateportal.skillname.unique')}} {{getI18n('zr.cl.iam.error.morethanmaxlength',255)}} {{getSkillProficiencyFromLevel(skill.body.level,'i18n')}} {{getI18n('crm.contactus.option.None')}} {{getI18n('crm.sme.skill.level.master')}} {{getI18n('crm.sme.skill.level.intermediate')}} {{getI18n('crm.sme.skill.level.beginner')}} {{if(skill.body.exp,getI18n('crm.indeed.workexp.years',skill.body.exp),getI18n('-None-'))}} 1 {{getI18n('crm.year.lower')}} {{getI18n('crm.indeed.workexp.years',exp)}} {{if(skill.body.lastUsed,skill.body.lastUsed,getI18n('-None-'))}} {{getI18n('crm.contactus.option.None')}} {{year}}
{{getI18n('crm.sme.refine.suggested')}}
{{suggSkill}}
{{getI18n('zr.candidateportal.add.skills')}} {{getCombinedSkillNames(skills,30,isSkillNameDoubleEncode)}}
{{if(isSkillNameDoubleEncode,trimContent(getTextContentFromHTML(unescape(skill.name)),25),trimContent(skill.name,25))}}
{{getI18n('zr.skillset.proficiency')}} - {{getSkillProficiencyFromLevel(skill.level,'i18n')}}
{{getI18n('Experience in years')}} - {{skill.exp}}
{{getI18n('crm.sme.skill.list.head.last.used')}} - {{skill.lastUsed}}
{{initializeFilterSkillsLength()}} {{initializeFilterSkillsLength()}} {{increaseFilterSkillsLength()}} {{trimContent(skill.name,25)}} {{skill.name}} +{{arithmetic(getFilterSkillsLength(skills),numTags,'-')}}
{{trimContent(currentJob.location,25)}} {{currentJob.location}} {{trimContent(currentJob.description,150)}} {{currentJob.description}} {{trimContent(currentJob.location,25)}} {{currentJob.location}} {{trimContent(currentJob.description,150)}} {{currentJob.description}} {{trimContent(currentJob.location,25)}} {{currentJob.location}} {{trimContent(currentJob.description,150)}} {{currentJob.description}} {{trimContent(location,25)}} {{location}} *
{{trimContent(type,25)}} {{type}}
Job Description
{{unescape(sanitizeHTML(descriptionHTML))}} {{unescape(removeUnwantedCss(org\_info.description))}} {{org\_info.description}}
