Senior Data Engineer
Location Cairo Category Software & Applications 51522355 Posted Date 10/01/2024
JOB DESCRIPTION
Job Description:
Job Summary:
The Data Engineer will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices.
Duties and Responsibilities:
Optimize and enhance data processing performance by identifying and resolving performance issues. Develop, implement & test scripts and programs in Python to automate data processing and analysis tasks. Utilize complex SQL for data extraction, manipulation, transformation, loading, optimizing performance and efficiency. Design, model and optimize data models and data structure for efficient reporting analysis, data visualization and data sharing. Collaborate with other teams such as business intelligence, applications, and consultants, to understand and meet client’s data needs and challenges. Perform data analysis and profiling to identify data quality issues anomalies and opportunities for improvement. Participate in managing and monitoring data security and access anomalies. Document and update procedures and best practices related to Python, libraries, algorithms, and related data processing technologies and propose innovative solutions.
Requirements and Qualifications:
Must have from 4 - 8 years of experience in data engineering
Cloud computing platforms: AWS/Azure/GCP
Experience in data integration
(ETL/ELT) development using
Python, PySpark, and SparkSQL. Data warehouse technologies: Redshift/Snowflake/BigQuery Data lake technologies: Hadoop, Spark, and Hive Orchestration: Airflow/Control-M/(Any Orchestration tool) Machine learning frameworks: TensorFlow, PyTorch, and sci-kit-learn Excellent problem-solving and analytical skills. Strong communication and interpersonal skills Excellent English communication
Please read the Job Description very well before applying
Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services, such as false websites, or through unsolicited emails claiming to be from the company. These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process. DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process, nor ask a job seeker to purchase IT or other equipment on our behalf. More information on employment scams is available
.
Location Cairo Category Software & Applications Posted Date 11/06/2024 Location Cairo Category Software & Applications Posted Date 11/06/2024 Location Cairo Category Software & Applications Posted Date 10/21/2024 Location Cairo Category Software & Applications Posted Date 11/06/2024 Location Cairo Category Software & Applications Posted Date 09/03/2024 Location Cairo Category Software & Applications Posted Date 10/21/2024 Location Cairo Category Software & Applications Posted Date 09/05/2024 Location Cairo Category Software & Applications Posted Date 08/23/2024 Location Cairo Category Software & Applications Posted Date 08/23/2024 Location Manila Category Software & Applications Posted Date 08/13/2024 Location Cairo Category IT Engineering & Architecture Posted Date 09/05/2024 Location Singapore Category Software & Applications Posted Date 05/07/2024
Privacy Preference Center
Manage Consent Preferences
Always Active Always Active Always Active
