DATA ENGINEER

Job Description:

We are seeking a talented and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have proficiency in big data technologies, strong programming skills, and extensive experience in data modeling, ETL processes, and SQL. Knowledge of cloud services, particularly AWS, Azure, and GCP, is preferred. Additionally, experience with Palantir Foundry, Dataiku, Alteryx, and Databricks UAP is highly desirable.

Responsibilities:

• Design, develop, and maintain scalable big data solutions using Spark, Python, Scala, and/or Java.
• Implement efficient ETL processes to extract, transform, and load data from various sources into our data infrastructure.
• Collaborate with cross-functional teams to understand data requirements and design appropriate data models.
• Optimize and tune existing data pipelines for performance and reliability.
• Ensure data quality and integrity throughout the data lifecycle.
• Stay up-to-date with emerging technologies and best practices in big data engineering.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Minimum of 3 years of experience in big data engineering.
• Proficiency in Spark is preferred; experience with other big data technologies such as Hadoop, Kafka, or Flink is a plus.
• Strong programming skills in Python, Scala, and/or Java.
• Solid understanding of data modeling concepts and techniques.
• Experience with database management systems and SQL.
• Knowledge of cloud services (AWS, Azure, GCP) is preferred.
• Familiarity with Palantir Foundry, Dataiku, Alteryx, and/or Databricks UAP is a plus.
• Excellent problem-solving and communication skills.
• Ability to work effectively in a fast-paced, collaborative environment.

Nice to Have:

• Experience working on projects related to smart city initiatives or government sectors.

Vertical

Technology