Job Description
Job Overview: Builds what the big data solutions architect has designed. Big data engineers develop, maintain, test and evaluate big data solutions within organizations.
Responsibilities
- Create and maintain optimal big data pipeline architecture
- Assemble large, complex data sets that meet business requirements.
- Build large-scale data processing systems with the latest (NoSQL) database technologies.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
- Identify ways to improve data reliability, efficiency, and quality
- Ensure data availability and accessibility by the right parties
- Guarantee data pipelines adhere to data governance practices
