Job Brief: VentureDive is seeking a highly experienced Senior Data Engineer to join our growing team of analytics experts. The hire will be responsible for leading and expanding our data and data pipeline architecture, as well as driving data flow optimization and collection across multiple teams and products. The Senior Data Engineer will provide technical leadership and support to software developers, database architects, data analysts, and data scientists on data initiatives, and will ensure optimal data delivery architecture is consistent throughout ongoing and future projects. He/She must be able to drive technical solutions and provide guidance to multiple teams, systems, and stakeholders, while staying up to date with industry trends and emerging technologies. VentureDive Overview: Founded in 2012 by veteran technology entrepreneurs from MIT and Stanford, VentureDive is the fastest growing technology company in the region that develops and invests in products and solutions that simplify and improve the lives of people world-wide. We aspire to create a technology organization and an entrepreneurial ecosystem in the region that is recognized as second to none in the world. Key Responsibilities:
Lead the design and development of optimal data pipeline architecture and provide technical guidance to the team.
Collaborate with cross-functional teams, including the Product, Data, and Design teams, to identify, design, and implement internal process improvements that optimize data delivery, automate manual processes, and enhance infrastructure scalability.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloud 'big data' technologies.
Develop analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Lead efforts to strive for greater functionality in our data systems and collaborate with data and analytics experts to identify areas for improvement.
Experience:
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of non-relational databases (MongoDB)
Proven track record of building and optimizing 'big data' data pipelines, architectures, and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytics skills related to working with structured and unstructured datasets.
Ability to build processes supporting data transformation, data structures, metadata dependency, and workload management.
Successful history of manipulating, processing, and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
Strong project management and organizational skills.
Experience leading and supporting cross-functional teams in a dynamic environment.
Required Qualifications:
Bachelor's or Graduate degree in Computer Science, Information Systems, or another quantitative field.
4+ years of relevant work experience in data engineering, data architecture, or a related field such as software engineering
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
Experience with cloud services such as AWS, Azure, or GCP.
Expertise in object-oriented/object function scripting languages such as Python, Java, C++, Scala, etc.
Experience leading and managing technical teams.
Data pipeline
Big data tools such as Hadoop, Spark, Kafka, etc.
Stream-processing systems such as Storm, Spark-Streaming, etc.
In order to thrive at VentureDive, you …are intellectually smart and curious …have the passion for and take pride in your work …deeply believe in VentureDive’s mission, vision, and values …have a no-frills attitude …are a collaborative team player …are ethical and honest Are you ready to put your ideas into products and solutions that will be used by millions? You will find VentureDive to be a quick pace, high standards, fun and a rewarding place to work at. Not only will your work reach millions of users worldwide, you will also be rewarded with competitive salaries and benefits. If you think you have what it takes to be a VenDian, come join us ... we're having a ball!
