Log In
Sign Up
We are looking for AWS PySpark Developer – Clinton, NJ. This is a contract position.
Note: This will be remote until COVID
Required Skills
- 4 to 6 years of Hands on experience in Development
- 2 to 4 years of Hands on experience with Python scripts
- 2 to 3 years of Hands on experience in PySpark coding. Worked in spark cluster computing technology.
- Min 2 years hands of experience on AWS DMS service to setup DMS, handling data format issues & monitoring DMS logs.
- Should have working experience on importing multiple RDMS data, Creating Replication tasks & applying filtering conditions on source endpoints using AWS DMS
- 2 to 3 years of Hadoop ecosystem Hortonworks or Cloudera experience which include Hive Beeline Hive2 Oozie HDFS etc.
- 2 to 3 years of Hands on end to end data pipeline experience working on AWS environments
- 3 to 4 years of Hands on experience working on AWS services Glue Lambda Step Functions EC2 RDS SES SNS DMS CloudWatch etc.
- 2 to 3 years of Hands on experience working on AWS redshift
- 3 plus years of Hands on experience with writing Unix Shell scripts
- Experience in coming up with creative solutions to optimize the code to solve the performance issues and create frameworks
- Good communication skills
- Excellent debugging and Performance tuning skills on AWS environment
- 3 plus years of working experience in Data warehousing projects Staging Dimensions Facts SCD Type 1 SCD Type 2.
- Familiarity with Data lake Data migration and Data integration concepts. Having knowledge in OLAP OLTP systems.
- Experience in Agile Waterfall methodologies. Familiar with SDLC phases such as design development Testing UAT etc.
- Experience working on SQL skills
- Experience working in an Onsite Offsite Development Model
Job Types: Full-time, Contract
Salary: Up to $50.00 per hour
Experience:
- AWS: 2 years (Required)
- Python Scripting: 2 years (Required)
- Data warehouse: 3 years (Required)
Work Remotely:
- Temporarily due to COVID-19
