Data Platform Architect

About Your Job:

In this role, you are responsible designing, implementing and maintaining enterprise self-service cloud data platform and architecture. You will design and build reference architectures, technical blueprints, accelerators for data product team to build data products. You will work closely with cross-functional teams to understand business requirements, select appropriate technologies, and develop scalable and reliable data platforms.

Key Responsibilities:

• Design and develop robust, scalable and high-performance self-serve data platform that empowers data product engineers to build data products as well as data analysts and business users to access and analyse data without the need for extensive technical expertise.
• Create and maintain reference and solution architecture blueprints.
• Produce high-quality user documentation, including architecture blueprints, design documents, and guidelines.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
• Select and implement appropriate technologies for the self-serve data platform, including tools for data ingestion, orchestration, storage & transformation.
• Ensure data security, compliance, and governance best practices are implemented across the platform.
• Optimize data infrastructure for performance, cost-effectiveness, and scalability.
• Monitor, analyze, and optimize data platform services.
• Stay up-to-date on the latest data platform technologies.
• Maintain knowledge of emerging technologies and architectures and lead proof of concepts.
• Provide technical leadership and mentorship to team members, guiding them on best practices and methodologies.

About you

• 8+ years of experience big data technologies, with at least 3 years in cloud data platform architect role.
• Strong expertise in GCP cloud services, data engineering, and platform architecture design to develop innovative solutions aligning with business objectives.
• Expertise in infrastructure as code (Terraform, Cloud Formation, etc.) and automation tools
• Knowledge of data mesh architecture
• Prior experience building large scale enterprise big data self-serve platforms.
• Strong understanding of cloud computing principles and architecture.
• Experience designing, developing, and implementing data ingestion pipelines, data processing pipelines, and data storage solutions.
• Proficiency in data engineering concepts, ETL processes, data warehousing, and data lakes.
• Experience with big data technologies, such as Hadoop, Spark, or Kafka
• Proficiency in programming languages such as Python, SQL, and experience with scripting.
• Deep understanding of GCP data platform technologies, including Dataproc, Dataflow, BigQuery, Pub/Sub, and Spanner etc.
• Strong analytical and problem-solving skills to address complex data challenges
• Excellent communication and collaboration skills to effectively interact with technical and non-technical stakeholders and collaboration skills to work effectively with cross-functional teams.
• Knowledge of airline domain will be an added advantage
• Knowledge of agile/lean development methodologies
• Knowledge of machine learning and artificial intelligence concepts.
• GCP certifications are a plus.