**Overview** Are you an experienced backend engineer with a passion for building large scale distributed systems to enable more innovations on the search, recommendation, and AI services and products. Are you passionate about working on drive and deliver the cutting-edge techniques such as LLM, AIGC by collaborating with AI data scientists? Bing IndexServe platform team have a Software Engineer 2 position to meet your technical expertise. Bing Fundamentals team focuses on providing a search and recommendation platform for Microsoft internal partners using the documentation recall and reranking backend service suite. As a team, we manage one of the world’s largest distributed systems and have experienced great success in building efficient large scale distributed systems for search. Bing Fundamentals team has a per decade rare opportunity to simplify the serving stack, to serve the biggest index with the most efficient way, and to drive up the relevance innovations with advanced deep learning and large language model techniques. The agility of engineering and deployment also presents as a big challenge when handling such a complex system. As Bing embraces the latest LLM innovations, the need for a platform to build up AI intelligence is becoming bigger. Within Bing Fundamentals, we are the IndexServe selection team and we have the exciting responsibility of trying to tackle these challenges. As a team, we are trying to build the most agile, performant, stable, experientable yet efficient index serving platform. On this platform, relevance techniques can be quickly implemented, iterated, qualified and flighted to evaluate their customer impacts with convenient while full-funnel debuggability. The same platform also provides all the cutting edged techniques and utilities, it has the most advanced AI toolset for our scientists to innovate, and for our products to serve most relevant documents. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.   Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction. **Responsibilities** + Apply AI tools and practices across the software development lifecycle to enhance quality, scalability, and efficiency. + Develop and review secure, maintainable, and performant code with comprehensive testing and advanced debugging techniques. + Design services that operate at large scale with low latency, high reliability, and optimized cost for maintenance and operations. + Conduct service performance profiling and implement strategies for scaling up systems effectively. + Incorporate security, privacy, and compliance requirements into all phases of development and deployment. + Plan and automate deployments, ensure safe rollouts, and establish disaster recovery and rollback strategies. + Work closely with multiple teams to design, deliver, and maintain reliable solutions, adding observability and improving live-site operations. **Qualifications** **Required Qualifications:** + Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python + OR equivalent experience. **Preferred Qualifications:** + Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python + OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python + OR equivalent experience. + Experience on high-performance computing (e.g. cache/memory optimization, high-performance GPU programming, compiler-based optimization, fine-grained parallel library and runtime) or large-scale distributed systems (e.g., communication optimization, network architecture design, network programming). + Capable of quantitatively implementing and qualifying a solution in a distributed environment with DevOps model. + Experience on Search/Ads/Recommendation areas. + Experience on performance analysis and optimization for both CPUs and GPUs, as well as good understanding on software-hardware codesig. This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations. (https://careers.microsoft.com/v2/global/en/accessibility.html)