our job will be to migrate from an IaaS Big Data platform to Azure-native Databricks. Responsibilities include:
  migrating and optimizing 500+ jobs using Databricks optimization techniques, managing 12 TB of data, tuning models for Azure with Java Spark and Delta tables, and addressing vulnerabilities through library version updates
It’s a hybrid/remote position.
Duration: ASAP - end of 2026

What we're looking for: Strong experience with Java and Spark for ETL processes. Hands-on expertise with Databricks and Delta tables. Solid knowledge of Microsoft Azure services (ADF, ADLS, APIM). Familiarity with SQL, data modelling, and optimisation techniques.