You’ve got positive energy. You’re optimistic about the future and determined to get there.
You’re never tired of learning. You want to be a pro in bleeding edge tech like DeFi, NFTs, DAOs, and Web 3.0.
Responsibilities:
– Build out and operate our foundational data infrastructure: storage (cloud data warehouse, S3 data lake), orchestration (Airflow), processing (Spark, Flink), streaming services (AWS Kinesis & Kafka), BI tools (Looker & Redash), graph database, and real-time large scale event aggregation store.
– Build the next iteration of our ingestion pipeline for scale, speed, and reliability. Read from a variety of upstream systems (MongoDB, Postgres, DynamoDB, MySQL, APIs), in both batch and streaming fashion, including change data capture. Make it self-service for non-engineers.
– Build and evolve the tools that empower colleagues across the company to access data and build reliable and scalable transformations. This includes UIs and simple frameworks for derived tables and dimensional modeling, APIs and caching layers for high-throughput serving, and SDKs for the orchestration of complex Spark and Flink pipelines.
– Build systems that secure and govern our data end to end: control access across multiple storage and access layers (including BI tools), track data quality, catalogue datasets and their lineage, detect duplication, audit usage, and ensure correct data semantics
Requirements:
– Data-oriented and product mindset
– Experience building data backend systems at scale with parallel/distributed compute
– Experience building API layers and microservices
– Experience with Python, Go and/or Java/Scala
– Knowledge of SQL
Assets:
Experience using data tools and frameworks like Airflow, Spark, Flink, Hadoop, Presto, Hive, or Kafka
Good understanding of common blockchain structure and features.
Experience with AWS, and especially EMR, S3, Glue, Kinesis, IAM
Computer Science or related engineering degree
Job Type: Full-time
Pay: $120,000.00 – $250,000.00 per year
Benefits:
Schedule:
Education:
Experience:
Work Location: Remote
Job Details ContractEstimated: $95,000 – $120,000 a year1 hour ago Qualifications React Front-end development Full-stack development Java Angular Full Job...
Apply For This JobJob Description: We are looking for a mid and/or senior level Full Stack developer who values exploration, discovery, efficiency, and...
Apply For This JobJob Details Full-time | ContractEstimated: $89,000 – $120,000 a year1 hour ago Qualifications React Spring Boot SQL Kafka Back-end development...
Apply For This JobJob Description Provide hands-on technical leadership in the development team. Drive the implementation of development activities, both individually and as...
Apply For This JobPosition Location: Centennial, CO Position Summary: VaST is seeking qualified candidates to fill our Software Engineer positions that include full...
Apply For This JobJob Details Estimated: $180,000 – $230,000 a year1 hour ago Qualifications J2EE ITIL Azure SQL Lean Bachelor’s degree Master’s degree...
Apply For This Job