Log In
Sign Up
Position: AWS ETL Developer
Location: Remote
Job Purpose:
Lead Amazon Web Service (AWS) data extract, transform, and load (ETL) architecture and design effort required to plan, architect, and design a complex, highly available and scalable data pipeline using AWS technologies across multiple Availability Zones within the AWS GovCloud.
Job Responsibilities:
· you will support efforts to architect, document, and validate ETL operations within a data pipeline design. As part of this effort, you will (1) identify and analyze source systems and necessary data ETL operations, (2) identify data and ingestion characteristics (e.g., source, volume, format, velocity, schedule), (3) develop a data dictionary for data that must be extracted, transformed and loaded, (4) define source-to-target data maps, (5) define backlog features for needed data ETL operations, (6) design and confirm the proposed ETL architecture and incorporate changes required to support non-functional requirements, and (7) define the solution’s concept of operations by describing data ingest, orchestration, and ETL journeys and cloud service offering configurations.
· You will support efforts to perform a Preliminary Design Review (PDR) with the Bank and use PDR feedback to finalize the high-level ETL design of data pipeline. To secure approval for the high-level ETL design, you shall help perform a Final Design Review (FDR), incorporating client feedback, as needed.
· The data pipeline will be part of a High Value Asset (HVA) that is rated as a FISMA “High Impact” system. For this reason, you will support efforts to design and architect the ETL architecture services using an AWS GovCloud infrastructure that employs cloud service offerings (CSO) that are FedRAMP authorized at the “High” Impact Level.
· Working with DevOps Engineer, document ETL CSO infrastructure requirements as infrastructure-as-code provisioning scripts.
Work Products:
You will support efforts to produce plan, design, and architecture deliverables that provide details required to support planning, implementation, and deployment of a data pipeline that ready for production use. Your work efforts will focus on design ETL architecture components and operations. Working with a team, you will help deliver the following:
· Data Dictionary, Entity Relationship Diagram
· Data Source-to-Target Mapping
· Product Backlog Data Transformation Features
· CloudFormation ETL Infrastructure Provisioning Scripts
· Non-Functional Requirements
· Architecture Diagrams and Descriptions
· High-Level Solution Design Document
· PDR and FRD Materials
· Concept of Operations Briefing
Required Skills:
Proven ability to productively support large-scale AWS cloud architecture and ETL design efforts for complex, highly available, and scalable data pipelines. This experience includes the following skills: data analysis and architecture, data ingest and ETL design, object storage and object lifecycle management design, extract-transform-load design, relational database design, and high availability and scalable cloud workload design.
Familiarity and ability to produce architecture and design deliverables that conform with Well Architected design principals is required.
Working knowledge of AWS Cloud Formation, GitLab, and ability to document ETL infrastructure requirements as infrastructure-as-code CloudFormation scripts.
Required Technologies:
Amazon Web Services (AWS) GovCloud, including Amazon S3, Amazon RDS SQL Server, Amazon Glue, AWS Lambda, Amazon Athena, Amazon Simple Notification Service, AWS Step Functions, AWS EventBridge, CloudWatch, CloudTrail, CloudFormation, GitLab, and related.
Required Education
and Certifications:
· Bachelor’s Degree or equivalent post high school education and/or work-related experience in Computer Science, Information Systems, or other Information Technology related field.
· AWS Solution Architect Associate certification is required.
· AWS ETL design and development experience.
Additional Preferred Skills, Certifications:
· AWS Data Analytics Specialty certification preferred, not required.
· AWS Database Specialty certification preferred, not required.
Job Type: Contract
Salary: From $70.00 per hour
Education:
Experience:
- AWS: 5 years (Preferred)
- ETL: 10 years (Preferred)
License/Certification:
- AWS Certification (Preferred)
Work Location: Remote