**Introduction** A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences. **Your role and responsibilities** * Establish and implement best practices for DBT workflows, ensuring efficiency, reliability, and maintainability. * Collaborate with data analysts, engineers, and business teams to align data transformations with business needs. * Monitor and troubleshoot data pipelines to ensure accuracy and performance. * Work with Azure-based cloud technologies to support data storage, transformation, and processing **Required technical and professional expertise** * 9+ Yrs total experience in IT/Data Engineering projects & 5+ years of relevant experience. * Strong coding skills in - Python, SQL, ADF, Databricks (PySpark, Delta live table, Live/structural data streaming, Unity Catalog, Performance Tuning of DLT pipelines with high volume of data processing , Cost Optimization of Databricks when DLT runs in live streaming on Photon, Serverless, non serverless)Azure Functions, Logic Apps * The DE role are expected to have AI, Gen AI to be efficient and innovation in developement. * Using Gen AI in developing automated data pipelines for faster delivery , Can a data engineer use agents or LLM to build data pipelines * The candidate should be responsible, take ownership, self driven, dedication to achieve timeline. * Should have great problem solving and analytical/reasoning capability, technical skill with good mindset and behavior is important good hands-on programming / scripting lnowledge in Python, * Very strong skilled resources only with good communication-knowledge in Power BI * * Strong MS SQL, Azure Databricks experience * Implement and manage data models in DBT, data transformation and alignment with business requirements. * Ingest raw, unstructured data into structured datasets to cloud object store. * Utilize DBT to convert raw, unstructured data into structured datasets, enabling efficient analysis and reporting. * Write and optimize SQL queries within DBT to enhance data transformation processes and improve overall performance **Preferred technical and professional experience** * Establish best DBT processes to improve performance, scalability, and reliability. * Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Databricks * Proven interpersonal skills while contributing to team effort by accomplishing related results as required IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.