Job Overview: Builds what the big data solutions architect has designed. Big data engineers develop, maintain, test and evaluate big data solutions within organizations.
Responsibilities
Create and maintain optimal big data pipeline architecture
Assemble large, complex data sets that meet business requirements.
Build large-scale data processing systems with the latest (NoSQL) database technologies.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
Identify ways to improve data reliability, efficiency, and quality
Ensure data availability and accessibility by the right parties
Guarantee data pipelines adhere to data governance practices
