**Introduction** A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences. **Your role and responsibilities** As a Data Engineer specializing in Data Platforms on Azure, you will advise on, develop, and maintain data engineering solutions on the Azure Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various Azure services. Your primary responsibilities will include: • Design, develop, and maintain robust data pipelines using DBT as a core transformation framework • Build and optimize data processing workflows using Python, PySpark, and Spark SQL • Develop scalable ETL and ELT solutions for large‑scale datasets • Work with Azure cloud services to manage data storage, compute, and orchestration • Implement data modeling, performance tuning, and pipeline optimization best practices • Collaborate with analytics teams, data scientists, and platform engineers to support enterprise analytics and AI initiatives • Ensure data quality, governance, and reliability across the data ecosystem **Required technical and professional expertise** • Strong hands‑on experience in DBT (must have) • Proficiency in Python, PySpark, and Spark SQL • Solid experience in data engineering and big data processing • Experience working with cloud platforms, preferably Azure • Strong understanding of data modeling, performance tuning, and optimization • Proven experience handling and processing large‑scale datasets • 5 to 8 years of experience in Data Engineering roles • Prior experience supporting enterprise analytics or AI platforms **Preferred technical and professional experience** • Exposure to AI or ML pipelines, including Generative AI workflows • Experience with Snowflake • Knowledge of data orchestration tools such as Airflow or Azure Data Factory • Familiarity with CI/CD and DevOps practices for data platforms IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.