Master Thesis: Optimization of KV-Cache in Distributed LLMs
Siemens
**Job Family:** Research & Predevelopment
**Req ID:** 472089
Mode of Employment: Fixed Term / Full- or Part-TimeAre you ready to shape the future of edge AI technologies? Join us as a Master Thesis student in GCH FL and dive into optimizing KV-Cache in Distributed LLMs, where your analysis and innovations will drive performance in new, exciting ways!What we offer you Exciting research and development projects that put your theoretical knowledge into practice Individual supervision and support from experienced experts in your field Access to the latest technologies, laboratories, and resources Diverse opportunities to contribute your ideas and actively shape the projects Excellent career opportunities through contact with potential employers You'll make an impact byYou perform a comprehensive analysis of existing Large Language Model (LLM) frameworks and approaches to identify areas for optimizationFollowing this, you evaluate and compare different optimization strategies for edge deployment to enhance system performanceSubsequently, you develop improvements for KV-Cache management in distributed LLMs, focusing on efficiency and scalabilityYou then implement and test these optimization approaches within edge networks to ensure they meet performance criteriaFinally, you contribute to the creation or extension of frameworks for distributed LLM deployment, documenting the process and results to advance edge AI technologies This is how you'll win us over Education: You are currently pursuing a Master's degree in Computer Science, Electrical Engineering, or a related field with a focus on AI, distributed systems, or edge computingExperience and Skills:Proficient in programming with Python and C++Experienced in working with Linux systems and network managementFamiliar with AI frameworks, Large Language Models, and performance optimization techniquesWays of Working: You demonstrate an analytical mindset with strong problem-solving abilities, are independent in your work, and have excellent documentation and communication skillsLanguages: Fluent in English with good communication skills in German both written and spoken You are much more than your qualifications, and we believe in the potential of every single candidate. We look forward to getting to know you! Your individual personality and perspective are important to us. We create a working environment that reflects the diversity of the society and support you in your personal and professional development. Let’s get to know your authentic personality and create a better future together with us. As an equal-opportunity employer (https://www.siemens.com/de/de/unternehmen/jobs/arbeiten-bei-siemens/inklusion.html) we are happy to consider applications from individuals with disabilities. About Us The world never stands still. And new challenges arise every day. With a passion for questioning things, for supplying ideas, and intelligently driving things forward we are helping society move towards a smarter tomorrow. Be it with technologies that reduce carbon emissions in cities or hyperintelligent robots. This is how we are able, to tackle the most important projects and push them forward together. Help us shape the future. www.siemens.de/careers (http://www.siemens.com/de/en/company/jobs.html) – if you would like to find out more about jobs & careers at Siemens. FAQ (https://www.siemens.com/global/en/company/jobs/faq.html) – if you need further information on the application process.\#sagthesisConducting
Confirmar seu email: Enviar Email
Todos os Empregos de Siemens