Role Purpose:
The Cloud Engineer is responsible for ensuring the stability, performance, and scalability of the Data Transformation Platform hosted in Microsoft Azure. This role involves both operational support to maintain platform availability and the implementation of new features based on stakeholder requirements.
The engineer will work closely with cross-functional teams to design, build, and optimize infrastructure and CI/CD workflows using tools such as Azure DevOps, Terraform, and Databricks. Collaboration with developers to build data ingestion and transformation pipelines is a key part of the role.
Key Accountabilities / Responsibilities:
Support the uptime and reliability of the data transformation platform, addressing both operational issues and feature enhancements requested by stakeholders.
Build and maintain scalable and reliable CI/CD pipelines using Azure DevOps for infrastructure and application deployments.
Collaborate with data engineers, developers, and security teams to ensure robust and secure platform operations.
Maintain accurate and current platform documentation, including thorough documentation for all newly developed features.
Participate in an out-of-hours (OOH) support rota as required.
Required Skills & Experience:
Proven hands-on experience with Microsoft Azure, particularly Azure Databricks and data integration workflows.
Strong expertise in Infrastructure as Code (IaC) using Terraform within Azure environments.
Solid understanding of Azure networking components such as VNets, NSGs, VPNs, Private Endpoints, and DNS.
Experience in building and managing Azure DevOps pipelines for deploying code, infrastructure, and data workflows.
Familiarity with monitoring and logging tools like Azure Monitor, Log Analytics, or equivalent.
Proficient in scripting languages such as PowerShell, Bash, or Python.
Knowledge of cloud security best practices, including IAM, RBAC, Azure Key Vault, and governance policies.
Strong communication and collaboration skills, with the ability to produce clear, structured documentation.
Prior experience working in Data Platform teams is preferred.