Bayt.com
https://bayt.page.link/v1TUmrkCw1dqRip19
Back to the job results
Full Time Employee · Min 8 Years of Experience
100-499 Employees · IT Services - Software Development

Get the Bayt App

Download the Bayt App to manage your real time conversation with the recruiter
Download App
Create a job alert for similar positions

Job Description

Summary: We are seeking a Data Engineer with deep expertise in ETL/ELT, PySpark, Databricks, Azure ecosystem, and experience with Enterprise Systems like Oracle ERP, ERP Fusion, and Salesforce.  The successful candidate will play a key role in designing and implementing complex data pipelines, handling both structured and unstructured datasets, and optimizing our Azure-based data systems. The successful candidate will have a strong foundation in data warehousing concepts and database design. Additionally, this individual will work closely with other data engineers & the data science team to support their analytics needs and improve the performance of our data products.


Key Responsibilities:

  • Design, construct, install, test, and maintain highly scalable and robust data management systems.
  • Understand and apply data warehousing concepts to design and implement robust data warehouse tables in line with business requirements.
  • Build complex ETL/ELT processes for large-scale data migration and transformation across platforms and Enterprise systems such as: Oracle ERP, ERP Fusion, and Salesforce.
  • Ability & expertise to extract data from several sources like APIs, Jsons, Databases etc
  • Leverage PySpark and Databricks within the Azure ecosystem to manipulate large datasets, improve the performance, and enhance scalability of our data operations.
  • Develop and implement Azure-based data architectures consistent across multiple projects while adhering to best practices and standards.
  • Lead initiatives for data integrity and normalization within Azure data storage and processing environments.
  • Evaluate and optimize Azure-based database systems for performance efficiency, reusability, reliability, and scalability.
  • Troubleshoot complex data-related issues within Azure and provide expert guidance and support to the team.
  • Ensure all data processes adhere to governance, data security, and privacy regulations.

Skills

Required Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • 8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer.
  • Expertise in Python, SQL, and deep understanding of PySpark.
  • Proficient in Databricks or similar big data solutions.
  • Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.
  • Proven experience in designing and deploying high-performance data processing systems on.
  • Extensive experience with Azure cloud data platforms, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks.
  • Ability to design and implement data schemas, data models, and database designs in accordance with business requirements.


Preferred Qualifications:

  • Databricks certification or equivalent big data technology certification.
  • Exceptional analytical and problem-solving abilities.
  • Excellent communication skills.

Preferred Candidate

Years of Experience
Min: 8
Loading... Email to Friend Complete Questionnaire
VDart logo
VDart
Follow Unfollow

VDart - We are a global, emerging technology staffing solutions provider with expertise in SMAC (Social, Mobile, Analytics & Cloud), Enterprise Resource Planning (Oracle Applications, SAP), Business Intelligence (Hyperion), and Infrastructure services. We work with leading System Integrators in, the private and public sectors. We have deep industry expertise and focus in BFSI, Manufacturing, Energy & Utility, Healthcare and Technology sector. Our scope, knowledge, industry expertise, and global footprint have enabled us to provide best in the industry solutions. With our Core focus in emerging technologies, we have provided global technology workforce solutions in USA, Canada, Mexico, Brazil, UK, Australia & India. We take pride in delivering specialized talent, superior performance, and seamless execution to meet the challenging business needs of customers worldwide.

See Company Details
You have reached your limit of 15 Job Alerts. To create a new Job Alert, delete one of your existing Job Alerts first.
MANAGE
Similar jobs alert created successfully. You can manage alerts in settings.
MANAGE
Similar jobs alert disabled successfully. You can manage alerts in settings.
MANAGE