[New York, NY, 10075.., New York, United States | Posted - 01/02/24
Job Description
Azure Data Engineer
New York, NY 10017
Azure Cloud Expertise:
Design, implement, and optimize data solutions on the Azure cloud platform, ensuring scalability, security, and performance.
Azure Data Factory and Databricks:
Develop and maintain data pipelines using Azure Data Factory for efficient and reliable data movement.
Leverage Azure Databricks for analytics and data exploration
SQL and DBT:
Design and optimize SQL-based queries for data extraction, transformation, and loading processes.
Implement and manage DBT (Data Build Tool) workflows to transform raw data into meaningful insights, ensuring data quality and consistency.
Data Architecture and Modeling:
Collaborate with data architects to design and implement scalable and maintainable data models.
Ensure adherence to data governance and compliance standards in data modeling and architecture.
Performance Optimization:
Identify and address performance bottlenecks in data pipelines and database queries.
Implement strategies to optimize data processing and reduce latency in data delivery.
Collaboration and Documentation:
Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions.
Document data engineering processes, data flows, and architecture to facilitate knowledge transfer and ensure maintainability.
Qualifications:
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Proven experience as a Data Engineer with a focus on Azure cloud technologies.
Strong proficiency in Azure Data Factory, Azure Databricks, SQL, and DBT.
10+ years in the data and analytics space with experience in designing and implementing scalable and robust data architectures.
Excellent problem-solving skills and the ability to troubleshoot complex data issues.
Strong communication skills and the ability to collaborate effectively with cross-functional teams.
Relevant certifications in Azure cloud technologies are a plus.