Who We Are
At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.
The Role
Kyndryl is at the forefront of Agentic AI innovation, building cutting-edge platforms that enable enterprises to harness the full potential of artificial intelligence at scale. We believe the future lies in resilient, intelligent systems that seamlessly move from experimentation to real-world impact.
At Kyndryl, you’ll join a dynamic, global team shaping how Agentic AI is built, deployed, governed, and operated in production. Your work will directly influence how enterprises adopt generative and Agentic AI - securely, reliably, and responsibly.
We are seeking an experienced ML Ops Engineer to design, deploy, and operate production-ready generative AI systems that power a platform for building AI-enabled business applications.
This role sits at the intersection of machine learning, cloud engineering, and platform operations. You will be responsible for ensuring that AI models, particularly large language models, are scalable, observable, performant, and continuously improve in real-world enterprise environments.
You will collaborate closely with AI engineers, architects, platform developers, DevOps, and product teams to bring advanced AI capabilities into production with confidence.
Key Responsibilities
Design, build, and operate end-to-end ML/AI lifecycle pipelines, covering training, fine-tuning, deployment, monitoring, and retraining of generative AI models.
Productionize generative models (e.g., LLMs, diffusion models) to support capabilities such as automated code generation, workflow creation, data synthesis, and AI-assisted application development.
Partner with architects and platform teams to integrate AI services via APIs, ensuring reliability, scalability, and secure interaction with backend and frontend systems.
Build and optimize data and feature pipelines to support high-quality training and inference at scale.
Implement model performance optimization techniques (e.g., caching, quantization, pruning, batching) to meet latency, throughput, and cost targets.
Deploy and operate AI workloads using cloud-native and containerized environments (Kubernetes, EKS, AKS, GKE), with a strong focus on automation and resilience.
Establish monitoring, observability, and alerting for model performance, data drift, bias, and system health in production.
Collaborate with DevOps and security teams to embed CI/CD, governance, and responsible AI controls into the AI delivery lifecycle.
Continuously evaluate and adopt emerging MLOps and AIOps practices, tools, and architectures to improve platform maturity.
Your Future at Kyndryl
Every position at Kyndryl offers a way forward to grow your career. We have opportunities that you won’t find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector, you can find your opportunity here.
Who You Are
4+ years of experience in ML Engineering, MLOps, AIOps, or Platform Engineering, with hands-on responsibility for production systems.
Strong proficiency in Python and ML frameworks such as PyTorch, or TensorFlow
Proven experience deploying, operating, and scaling AI/ML models in production environments.
Hands-on experience with cloud platforms(AWS, Azure, Google Cloud) and their AI/ML services.
Strong knowledge of containerization and orchestration(Docker, Kubernetes).
Experience building CI/CD pipelines for ML systems, including model versioning and rollback strategies.
Familiarity with data engineering tools (e.g., Pandas, Spark) and version control systems (Git).
Ability to diagnose and resolve issues related to model performance, data quality, bias, and system scalability.
Strong communication skills, with the ability to explain technical trade-offs to both technical and non-technical stakeholders.
Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent experience).
Preferred Qualifications
Experience operating generative AI and LLM-based systems in enterprise environments.
Familiarity with AI monitoring, observability, and governance tools.
Exposure to agentic AI architectures, workflow orchestration, or AI-driven automation platforms.
Background in NLP, computer vision, or multi-modal AI systems.
Contributions to open-source projects, internal AI platforms, or published technical work.
Why Join us
The chance to architect and operate critical infrastructure at the cutting edge of AI.
A collaborative environment where DevOps and platform engineering are deeply valued.
Competitive compensation, equity options, remote flexibility, and support for certifications or conference attendance.
The opportunity to work on impactful, real-world AI systems alongside a highly skilled and passionate team.
#AgenticAI
Being You
The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.
What You Can Expect
Your career with us isn’t just a job—it’s an adventure with purpose. We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.
Get Referred!
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.