Big Data Expert
Job Description
Design and implement scalable big data architectures to handle large volumes of data. Develop and optimize data processing pipelines using technologies such as Hadoop, Spark, and Kafka. Collaborate with data scientists and analysts to provide data insights and support advanced analytics. Manage and maintain big data platforms, ensuring high availability and performance. Perform data extraction, transformation, and loading (ETL) tasks from various data sources. Implement data security measures to protect sensitive information. Monitor and troubleshoot data processing systems to ensure reliability and efficiency. Evaluate and integrate new big data technologies to enhance data processing capabilities. Provide technical leadership and guidance to the data engineering team. Stay abreast of industry trends and advancements in big data technologies to drive innovation.
Personal Skills
Excellent communication skills Flexibility to work under pressure and in different environments. Problems solving skills. Leadership skills. Excellent organizational and administrative skills.
Technical Skills
• Big Data Technologies: Proficient in Hadoop, Spark, Kafka, and related ecosystems.
• Programming Languages: Strong coding skills in Java, Scala, Python, or R.
• Data Processing: Expertise in ETL processes and data pipeline development.
• Database Management: Knowledge of NoSQL databases like Cassandra, MongoDB, and HBase.
• Cloud Platforms: Experience with cloud services such as AWS, Azure, or Google Cloud for big data solutions.
• Data Analysis: Advanced analytical and problem-solving skills.
• Performance Optimization: Ability to optimize big data architectures for performance and scalability.
• Data Security: Understanding of data security practices and tools to safeguard data.
• Collaboration: Strong team collaboration skills, working with data scientists, analysts, and other stakeholders.
• Continuous Learning: Commitment to staying updated with the latest trends and advancements in big data technologies.
Job Location Cairo, Egypt Job Role Engineering Years of Experience Min: 7 Max: 12
