● Data ingestion and integration: Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure.
● Data transformation and processing: perform data transformation and processing tasks to prepare the data for analysis and reporting.
● Data storage and management: Select and manage the appropriate storage solution for the data.
● Data warehousing: Implement data warehousing solutions.
● Data modelling and analysis: Design and implement data models for analytical workloads. Data modelling and analysis: Design and implement data models for analytical workloads.
● Data governance and security: Ensure data governance and security practices are implemented using tools like Purview and Profisee. Set-up data access controls, implement encryption, monitor data quality, and establish data retention policies.
● DevOps and automation: Automate data pipelines, monitor data processes, and manage deployments.
● This is a hands-on data engineering role. Only candidates with prior Microsoft Azure data engineering experience will be considered. Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE) are essential.
● Bachelor’s degree in Computer Science, Engineering, or related technical field. Master’s degree is preferred.
● Ideal candidate will have 9-10 years of total work experience. At least 6 years of experience as a Azure data engineer is a must.
● Sound skills and hand-on experience with Azure Data Lake, Databricks, Azure Synapse Analytics, Azure Data Factory, Cosmos DB, SQL Data Warehouse Azure Blob, Azure Storage Explorer.
● Proficient in creating Data Factory pipelines for on-cloud ETL processing; copy activity, custom Azure development etc.
● Hands-on experience of Azure Data Catalog, Event Grid, Service Bus, SQL and Synapse.
● A passion for writing high-quality code and the code should be modular, scalable, and free of bugs (debugging skills in SQL, Python, or Scala/Java).
● Mandatory experience: Master Data Management (MDM) and Data Governance leveraging Microsoft Purview and Microsoft Profisee.
● Good technical knowledge in SQL Server BI suite (ETL, Reporting, Analytics, Dashboards) using SSIS, SSAS, SSRS and Power BI.
● Good knowledge of building and designing REST APIs with realtime experience working on Data Lake or Lakehouse projects.
● Prior project experience in pharma, healthcare and life sciences will be advantageous.
.svg){kind=small}
