Role: Data Engineer

Hire Type: FTE

Work Location: Bangalore (Client location)

About the Role:

We are seeking a highly motivated and experienced Data Engineer to join our team. In this critical role, you will be crucial in designing and developing a robust and scalable data architecture to support the continued growth and functionality of the system. You will ensure efficient data management and analysis, enabling data-driven decision-making and enhancing the user experience.

Responsibilities:

• Designing and implementing Azure Data pipelines for handling structured/semi structured datasets, apply complex data transformation rules.

• Utilizing Azure Data Factory, Azure Logic Apps, Azure Stream Analytics, Azure Data Lake, Azure SQL Server, Databricks and other Azure services for advanced data processing, analytics.

• Collaborating with the architects to establish data engineering best practices and standards within the Azure ecosystem to design and develop scalable data pipelines.

• Designing and developing batch and real time integration using Azure Event Hubs and Azure Functions.

• Designing and developing CI/CD pipelines.

• Familiarity with data modelling architectures (Kimball/Inmon) and its implementation.

• Familiarity with metadata driven frameworks on cloud.

• Experience with version and source control (Git) and Azure DevOps

• Experience in analyzing the Data Analytics and translate it to Technical Specification.

• Stay current with the latest data architecture trends and technologies and identify improvement opportunities

• Monitor the health and performance of infrastructure and identify and resolve issues proactively.

• Mentoring and guiding junior data engineers in Azure-specific technologies, fostering a culture of continuous learning.