Locations: Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit | Houston | Los Angeles | Miami | Minneapolis | Nashville | Summit | New York | Philadelphia | Pittsburgh | Durham | Washington
Who We Are
Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.
To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.
About BCG Platinion
BCG Platinion's presence spans across the globe, with offices in Asia, Europe, and South and North America. We achieve digital excellence for clients with sustained solutions to the most complex and time-sensitive challenge. We guide clients into the future to push the status quo, overcome tech limitations, and enable our clients to go further in their digital journeys than what has ever been possible in the past. At BCG Platinion, we deliver business value through the innovative use of technology at a rapid pace. We roll up our sleeves to transform business, revolutionize approaches, satisfy customers, and change the game through Architecture, Cybersecurity, Digital Transformation, Enterprise Application and Risk functions. We balance vision with a pragmatic path to change transforming strategies into leading-edge tech platforms, at scale.
What You'll Do
Key Responsibilities
Architect & Design
Prototype & Validate
Develop minimal viable prototypes or proof-of-concepts to test architectural decisions and accelerate innovation.Evaluate emerging AI frameworks and tools (e.g., LangChain, LlamaIndex, Semantic Kernel) for suitability and integration.Collaborate & Lead
Partner with product managers, data scientists, and engineers to translate business goals into robust AI system designs.Provide technical direction and mentorship to engineering teams on architectural patterns, scalability, and best practices.Serve as the subject matter expert on LLM integration, agentic system design, and intelligent automation frameworks.Operationalize
Oversee system performance, observability, and governance as solutions transition from prototype to production.Define standards for versioning, testing, and monitoring of models and AI services (LLMOps).Stay ahead of the curve on new techniques in distributed AI systems, retrieval-augmented generation (RAG), and agent frameworks.What Success Looks Like
Establishes a consistent, scalable architecture for AI solutions across teams.Rapidly prototypes and validates new architectural patterns for agentic and LLM-based systems.Becomes a go-to technical leader for AI design, ensuring solutions are both visionary and practical.Bridges the gap between strategic architecture and hands-on engineering excellence.What You'll Bring
Required Skills
Strong foundation in software architecture and distributed systems design.Proven experience designing or scaling AI/ML or LLM-based applications.Proficiency in one or more programming languages: Python, TypeScript, or Node.js.Familiarity with modern AI frameworks (LangChain, Semantic Kernel, AutoGen, CrewAI, LlamaIndex).Understanding of data management, cloud architecture, and API-based system integration.Experience with vector databases, context retrieval, and prompt orchestration patterns.Strong communication and documentation skills — able to clearly articulate complex system designs.Nice-to-Have
Experience with multi-agent systems, RAG, or knowledge graph integration.Familiarity with MLOps / LLMOps pipelines, observability, and evaluation frameworks.Exposure to frontend frameworks (React, Next.js) for intelligent app interfaces.Consulting or innovation lab experience — comfortable with ambiguity and rapid iteration.Who You'll Work With
About the Role
We are seeking an AI Systems Architect to design, guide, and evolve the architecture of next-generation intelligent systems. This role bridges high-level system design with hands-on engineering — ideal for someone who can envision complex AI-enabled ecosystems while still being comfortable prototyping or coding to validate ideas.
You’ll work across data, product, and engineering teams to define scalable architectures for AI-driven applications, enabling the seamless integration of large language models (LLMs), data pipelines, and enterprise systems.
Additional info
What We Offer:
At BCG, we care about our people, and offer best in class benefits to support you personally and professionally throughout your different life experiences including:
An opportunity to work organically across disciplines and across BCG, we offer a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment. BCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world's best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and where we are headed next. We count on your authenticity, exceptional work, and strong integrity. In return we are committed to supporting you in discovering the most fulfilling career journey possible-and unlocking your potential to advance the world.
FOR U.S. APPLICANTS:
The base compensation for this role is $230,000 in USD. In addition to your base salary, you will also be eligible for an annual discretionary performance bonus and retirement contribution. BCG also provides a market leading benefits package described below. At BCG, we are committed to offering a comprehensive benefit program that includes everything our employees and their families need to be well and live life to the fullest. We pay the full cost of medical, dental, and vision coverage for employees - and their eligible family members. That's zero dollars in premiums taken from employee paychecks.
All our plans provide best in class coverage:
Zero-dollar ($0) health insurance premiums for BCG employees, spouses, and children$10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugsDental coverage, including up to $5,000 (USD) in orthodontia benefitsVision insurance with coverage for both glasses and contact lenses annuallyReimbursement for gym memberships and other fitness activitiesFully vested retirement contributions made annually, whether you contribute or notGenerous paid time off including vacation, holidays, and annual office closure between Christmas and New YearsPaid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursementEmployees, spouses, and children are covered at no cost. Employees share in the cost of domestic partner coverage.To learn more about our employee benefit please check our BCG Benefits page.
Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.
BCG is an E - Verify Employer. Click here for more information on E-Verify.
Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.\n
BCG is an E - Verify Employer. Click here for more information on E-Verify.