Job Details
JPC - 676 - Sr Data Engineer
[Brooklyn, NY, 11220..,  New York,  United States | Posted - 02/06/2024
Job Description

Job Title: Senior Data Engineer

Location: 2 Metrotech, Brooklyn, NY 

Role Type: Contract (W2 only) 

Scope of Services:

The primary focus areas include data analysis for improving agency operations, making Open Data accessible, and advancing citywide data infrastructure. We are currently seeking a Senior Data Delivery and solution Engineer to play a key role in implementing and supporting complex data engineering solutions. 

Key Responsibilities:

  • Support the implementation of a new Master Data Management (MDM) Business Domain integrating multiple data sources and associated web services and APIs.
  • Develop architectural blueprints utilizing MDM as a foundational service, supporting the creation of unified profiles for business transactions.
  • Coordinate senior-level data engineers in building pipelines to MDM and selected data platforms under the guidance of Technical Leads.
  • Develop analytics tools utilizing data pipelines for actionable insights into customer engagement, operational efficiency, and key business performance metrics.
  • Review Extraction, Transformation, Load strategies (ETL) for data from various sources using SQL, cloud, and 'big data' technologies.
  • Create, update, and maintain system documentation.
  • Manage the development of APIs for data access or landing data for downstream consumption in the appropriate target data store.
  • Coordinate security scan accreditations.
  • Perform special projects and initiatives as assigned.

Mandatory Skills/Experience:

  • 8+ years managing the development and implementation of large technology projects, with at least 3+ years involving MDM implementation.
  • 8+ years of experience in writing SQL.
  • 8+ years of experience in copying, transferring, manipulating, and automating data operations.
  • Experience with data architecture tools like Informatica Power Center, IICS, SSIS, or similar ETL tools.
  • Experience with Amazon Web Services or Microsoft Azure cloud computing platforms.
  • In-depth knowledge of SQL and other database solutions.
  • Knowledge of modeling database schemas for large datasets.
  • Experience developing cloud-ready applications.
  • Experience with programming languages like Python, Java, and Perl.

Desirable Skills/Experience:

  • 5+ years hands-on experience in development with Informatica PowerCenter and B2B Data Transformation.
  • Experience with Oracle 10g/11g, SQL Server, and/or a database appliance.
  • Knowledge of metadata-driven enterprise reporting platforms.

Special Requirements:

  • Strong hands-on experience with Master Data Management (MDM) implementation for a large enterprise.
  • Prior experience working on complex data integration projects for the City of New York.

Note: Candidates lacking mandatory skills/experience will not be considered.