We are looking for a Lead Data Engineer – Data Platforms & Engineering to join our Data Engineering Team in India. This is an amazing opportunity to work on Real World Data using big data technologies.
We would love to speak with you if you have skills in Python, Spark and have experience on building big data platforms.
About You – experience, education, skills, and accomplishments
- Education (bachelor's degree in computer science, mechanical engineering or related degree.
- At least 5 years of experience with database designing, pipelining and development
- At least years of experience on snowflake and relational databases like PostgreSQL or MySQL
- At least 2 years of experience working on Spark, PySpark, Hive, Airflow and AWS (or any other cloud platform)
- Proficient with writing SQL queries, Stored Procedures and Views
- Passion for learning and a desire to grow!
It would be great if you also had . . .
- Familiarity with any Talend, Tableau and Snowflake would be added advantage.
- Experience in building big data platforms.
- Understanding on healthcare data.
What will you be doing in this role?
- Define and implement our data platform strategy on Cloud, have a meaningful impact on our customers, and working in our high energy, innovative, fast-paced Agile culture.
- Drive rapid prototyping and development with Product and Technical teams in building and scaling high-value medical data capabilities.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using Apache suite (airflow, spark), SQL, Python, ETL, and AWS big data technologies.
- Creation and support of batch and real-time data pipelines and ongoing data monitoring and validation built on AWS/Snowflake/Apache technologies for medical data from many different sources.
- Conduct functional and non-functional testing, writing test scenarios and test scripts.
- Evaluate existing applications to update and add new features to meet business requirements.
Product you will be developing
Big Data Platforms
About the Team
The stakeholders for the role are Analytics team, Application Teams on the business side, Enterprise Solutions Teams and other Cross-Functional Internal IT Teams, External Vendors and Partners. The team consists of 30+ engineers and are reporting to the Director of technology.
Hours of Work
A full-time job with 40 hours of billable work every week. You will be working in IST time zone with a 12pm-9pm IST work shift; however, you may be required to attend occasional web-based client meetings in EST/CET time zone depending on the project requirement.
At Clarivate, we are committed to providing equal employment opportunities for all persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.
