Who We Are

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.

To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.

What You'll Do

Act as the technical lead for GenAI application development, owning architecture, design decisions, and implementation while remaining fully hands-on.Lead technical direction to set standards, review designs/PRs, mentor engineers, and align stakeholders on tradeoffsCollaborate with Product Owners, architects, designers, and stakeholders to translate business requirements into scalable GenAI solutions.Design and implement end-to-end GenAI pipelines that include document ingestion, embedding generation, vector storage, retrieval, and conversational interfaces.Build and maintain event-driven ingestion pipelines where content pushed to Amazon S3 triggers processing workflows for document parsing, chunking, embedding, and indexing.Implement and optimize RAG architectures on AWS Bedrock, using OpenAI LLMs and OpenSearch vector databases.Design and tune prompt engineering strategies, embedding models, chunking approaches, and vector search relevance to improve response accuracy and reliability.Develop GenAI services, agents, and APIs in Python, following clean code principles, modular design, and testable patterns.Architect and manage AWS infrastructure using services including S3, Lambda, Step Functions, Bedrock, OpenSearch, IAM, and CloudWatch.Build and maintain QuickSight dashboards (and/or integrate tools such as Arize AI and PromptFoo) to measure LLM accuracy, retrieval quality, latency, and system performance.Apply security, privacy, and compliance best practices, including data protection, access control, and responsible AI considerations.Lead code reviews, design reviews, and mentor engineers on GenAI best practices, cloud-native development, and production readiness.Partner with Agile teams to ensure timely delivery, continuous improvement, and alignment with non-functional requirements (scalability, performance, reliability, cost monitoring & optimization).Create and maintain technical documentation, including architecture diagrams, runbooks, and operational guides.Identify technical risks early, propose mitigation strategies, and contribute thought leadership to the broader GenAI roadmap.

What You'll Bring

12+ years of professional software engineering experience building enterprise-grade applications.3+ years of hands-on experience in GenAI / ML / NLP, including production use of LLM-based systems.Strong hands-on expertise with Python for backend and GenAI application development.Proven experience designing and implementing RAG systems, including:

o Prompt engineering

o Embedding generation

o Chunking strategies

o Vector search relevance tuning

Experience working with AWS Bedrock, OpenAI LLMs, etc., in production environments.Strong experience with AWS cloud services, including S3, Lambda, Step Functions, OpenSearch, IAM, and monitoring/logging tools.Hands-on experience with vector databases and search technologies, particularly OpenSearch.Experience designing event-driven and serverless architectures.Familiarity with LLM evaluation and observability, including metrics for accuracy, hallucination, latency, and cost.Experience building dashboards and analytics using Amazon QuickSight or similar tools.Strong understanding of RESTful APIs, microservices, and cloud-native integration patterns.Experience working in Agile/Scrum environments with cross-functional teams.Excellent communication skills with the ability to explain complex GenAI concepts to technical and non-technical stakeholders.

Nice to Have

Experience with or willingness to learn Sitecore Content Hub, DAM systems, or enterprise content platforms.Prior experience applying GenAI to content, document management, or digital asset workflows.Familiarity with GenAI evaluation tools such as Arize AI, PromptFoo, or similar frameworks.Experience with CI/CD pipelines, infrastructure as code, and DevOps best practices.Knowledge of data privacy, governance, and responsible AI frameworks.Experience with containerization (Docker) and orchestration concepts.

Exposure to frontend frameworks or conversational UI development.

Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience).

Personal Attributes

Strong problem-solving and analytical skills with a pragmatic, delivery-focused mindset.Self-starter who can operate independently while leading others in a collaborative team environment.Comfortable owning ambiguous problem spaces and driving solutions end-to-end.Passion for Generative AI, continuous learning, and applying emerging technologies responsibly.Strong leadership qualities with the ability to mentor, guide, and elevate team performance.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.\n
BCG is an E - Verify Employer. Click here for more information on E-Verify.