https://bayt.page.link/5hEud1Bg2dDpYXXn9

Software Architect

- Siemens
- بنغالورو, الهند

قبل 25 يوم 2024/12/23

أرفق خطاب مع سيرتك الذاتية

إتمام الإستبيان

التقديم على موقع الشركة

أنشئ تنبيهًا وظيفيًا للوظائف المشابهة

الوصف الوظيفي

As a Data Architect, you are required to:

Design & develop technical solutions which combine disparate information to create meaningful insights for business, using Big-data architectures

Build and analyze large, structured and unstructured databases based on scalable cloud infrastructures
Develop prototypes and proof of concepts using multiple data-sources and big-data technologies
Process, manage, extract and cleanse data to apply Data Analytics in a meaningful way
Design and develop scalable end-to-end data pipelines for batch and stream processing
Regularly scan the Data Analytics landscape to stay up to date with latest technologies, techniques, tools and methods in this field
Stay curious and enthusiastic about using related technologies to solve problems and enthuse others to see the benefit in business domain

Qualification:

Bachelor's or Master's in Computer Science & Engineering, or equivalent. Professional Degree in Data Engineering / Analytics is desirable.

Experience level:

Minimum 8 years in software development with at least 2 - 3 years hands-on experience in the area of Big-data / Data Engineering.

Desired Knowledge & Experience:
Data Engineer - Big Data Developer

Spark: Spark 3.x, RDD/DataFrames/SQL, Batch/Structured Streaming
Knowing Spark internals: Catalyst/Tungsten/Photon
Databricks: Workflows, SQL Warehouses/Endpoints, DLT, Pipelines, Unity, Autoloader
IDE: IntelliJ/Pycharm, Git, Azure Devops, Github Copilot
Test: pytest, Great Expectations
CI/CD Yaml Azure Pipelines, Continuous Delivery, Acceptance Testing
Big Data Design: Lakehouse/Medallion Architecture, Parquet/Delta, Partitioning, Distribution, Data Skew, Compaction
Languages: Python/Functional Programming (FP)
SQL: TSQL/Spark SQL/HiveQL
Storage: Data Lake and Big Data Storage Design

Additionally it is helpful to know basics of:

Data Pipelines: ADF/Synapse Pipelines/Oozie/Airflow
Languages: Scala, Java
NoSQL: Cosmos, Mongo, Cassandra
Cubes: SSAS (ROLAP, HOLAP, MOLAP), AAS, Tabular Model
SQL Server: TSQL, Stored Procedures
Hadoop: HDInsight/MapReduce/HDFS/YARN/Oozie/Hive/HBase/Ambari/Ranger/Atlas/Kafka
Data Catalog: Azure Purview, Apache Atlas, Informatica
Big Data Architect
Expert: in technologies, languages and methodologies mentioned in Data Engineer - Big Data Developer
Mentor: mentors/educates Developers in technologies, languages and methodologies mentioned in Data Engineer - Big Data Developer
Architecture Styles: Lakehouse, Lambda, Kappa, Delta, Data Lake, Data Mesh, Data Fabric, Data Warehouses (e.g. Data Vault)
Application Architecture: Microservices, NoSql, Kubernetes, Cloud-native
Experience: Many years of experience with all kinds of technology in the evolution of data platforms (Data Warehouse -> Hadoop -> Big Data -> Cloud -> Data Mesh)
Certification: Architect certification (e.g. Siemens Certified Software Architect or iSAQB CPSA)

Required Soft-skills & Other Capabilities:

Excellent communication skills, in order to explain your work to people who don't understand the mechanics behind data analysis
Great attention to detail and the ability to solve complex business problems
Drive and the resilience to try new ideas, if the first ones don't work
Good planning and organizational skills
Collaborative approach to sharing ideas and finding solutions
Ability to work independently and also in a global team environment.