Senior Big Data Engineer
Job Description
Design and implement large-scale data processing systems and pipelines. Develop, test, and deploy robust big data solutions using technologies like Hadoop, Spark, and Kafka. Optimize data storage and retrieval strategies for performance and efficiency. Collaborate with data scientists, analysts, and stakeholders to understand data requirements. Ensure data quality, integrity, and security across big data platforms. Lead efforts in data modeling, schema design, and data warehousing. Perform data extraction, transformation, and loading (ETL) from various data sources. Monitor and troubleshoot data processing jobs to ensure reliability and performance. Mentor junior engineers and provide technical guidance to the team. Stay current with emerging big data technologies and best practices to drive continuous improvement.
Personal Skills
Strong communication, interpersonal, and presentation skills. Ability to multi-task and work under pressure. Excellent command of English. Excellent verbal and written communication skills; influencing skills and ability to work effectively in a geographically dispersed team.
Technical Skills
• Big Data Technologies: Expertise in Hadoop, Spark, Kafka, and related ecosystems.
• Programming: Proficient in Java, Scala, and Python for data processing and pipeline development.
• Data Modeling: Strong skills in designing data models and schema for big data applications.
• ETL Processes: Advanced knowledge of ETL (Extract, Transform, Load) techniques and tools.
• Database Management: Experience with NoSQL databases like Cassandra, MongoDB, and HBase.
• Cloud Platforms: Proficient in using AWS, Azure, or Google Cloud for big data solutions.
• Performance Tuning: Ability to optimize data processing systems for performance and scalability.
• Data Security: Understanding of data security principles and best practices.
• Collaboration: Strong teamwork and communication skills for cross-functional collaboration.
• Problem-Solving: Excellent analytical and problem-solving abilities to address complex data challenges.
Education
Bachelor's degree in Computer Science, Software Engineering, or a related field.
Job Location Cairo, Egypt Job Role Engineering Years of Experience Min: 4 Max: 7
