As a Data Engineer you will be working in one of the world's largest cloud-based data lakes. You will be helping engineers navigate priorities and communicating clear expectations with customers. You will work with the data warehouse solutions for the Enterprise using multiple platforms (EMR, RDBMS, Columnar, Cloud). You will be involved in the design, creation, management, and business use of large datasets.
Key job responsibilities
As a Data Engineer you will be working in one of the world's largest cloud-based data lakes. You should be skilled at helping engineers navigate priorities and communicating clear expectations with customers. You should be knowledgeable in the architecture of data warehouse solutions for the Enterprise using multiple platforms (EMR, RDBMS, Columnar, Cloud). You should have experience in the design, creation, management, and business use of large datasets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions. You should be able to architect highly efficient data and reporting structures, making a tradeoff between scalability, performance and user functionality needs, using expert knowledge in software development technologies. You should develop long term domain/technology strategies and significantly influence the process and engineering standards in the team. You should be able to perform design reviews and offer feedback on design, integration, performance and scalability issues. Serve as an authority in the area of technical and domain expertise and mentor, develop, and train the engineers. Above all you should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive change.
In this role you will build a large-scale near real time data ingestion, calculation engine, and reporting solutions for Finance teams across the globe for Amazon. This person will work across other Amazon engineering teams and business teams in planning, designing, executing and implementing this analytical platform. This high impact role will have an opportunity to design and build our data infrastructure and work with emerging technologies such as Redshift and associated AWS cloud services while driving business intelligence solutions end-to-end: business requirements, workflow instrumentation, data modeling and ETL. You should be an expert at designing, implementing, and operating stable, scalable, low cost solutions to flow data from production systems into the data lake and into end-user facing applications. The role requires someone who loves data, understands enterprise information systems, has a strong business sense, and can lead a team to put these skills into action.
- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)