Job Details
JPC - 15031 - AWS Data Platform Engineer|| 2-3 Days onsite in either New York City, Lawrenceville, NJ or Washing DC. No relocation Notes:
[New York City, NY, ..,  New Jersey,  United States | Posted - 11/13/23
Job Description

AWS Data Platform Engineer

Location: 2-3 Days onsite in either New York City, Lawrenceville, NJ or Washing DC. No relocation

Notes:

This is an AWS Platform Engineer who is building the underlying platform that other Data Engineers will use. So, they need experience building out the Platform and a focus on Infrastructure as code.

Here is some specific details from the hiring manager. First 2 are mandatory and 3rd can be optional:

  • Infrastructure as Code(IaC) is required. AWS CDK with Typescript as language for CDK development
  • Working Experience/Expertise creating AWS infrastructure for AWS services
  • Some experience in Databricks environment

What you’ll do:

  • Build on the AWS data platform which supports Datalake, Job Orchestration, ETL template, ETL Compute, integration with third party tools like fivetran, Monte Carlo
  • Design, code and maintain infrastructure as a code (IaC) using CDK, typescript, CDKTF.
  • Build and improve workflow orchestration tooling to support efficient data pipelines E.g., airflow plugins, systems integration, deployments.

 

What you’ll need:

  • 7+ years’ experience developing infrastructure as Code working with AWS CDK, typescript/or Python.
  • 3+ years of experience working on AWS building out the cloud platform
  • AWS CDK with Typescript as language for CDK development
  • Working Experience for Job Orchestration tool – Airflow/MWAA
  • Working Experience/Expertise creating AWS infrastructure for AWS services including but not limited to: S3 Datalake, Kms keys, IAM Role/Policy, MWAA, RDS, Lambda function
  • Knowledge/Expertise on tools viz (Fivetran, Monte-Carlo, Datadog, Tableau/Looker)

Plus Skills

  • Experience/Expertise on Databricks and Monte Carlo is a plus.

Must be able to work onsite in either NYC, Lawrenceville, NJ, or Washington DC