Leader, Machine Learning Engineering
Milpitas
Thursday, 07 May 2026
The application window is expected to close on: 05/29/2026 Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received. Who We Are. The Cisco’s AI team consists of AI researchers, and software developers who collaborate to build innovative products and platforms for Cisco. We are motivated by tackling unique challenges that arise when connecting people and devices at a world-wide scale. Who You’ll Work With. You will join a newly formed, dynamic AI team as one of the core members, and have the opportunity to influence the culture and direction of the growing team. Our team includes AI experts and distributed system experts who work together with our partners in products management, and engineers across a wide variety of other Cisco teams. We are seeking a Software Engineer Technical Leader to join our AI Assistants Team, where you will play a vital role in integrating AI services for our Generative AI Assistant products. Your skills in understanding service operations and architecting/building effective interfaces between service boundaries with the right instrumentation will be essential for the success of our product. Your role will involve understanding the operations of each AI service, designing and building interfaces that seamlessly connect these services, and ensuring the appropriate instrumentation is in place. Your work will be instrumental in delivering a powerful and effective solution to our customers. What You Will Do. As a Technical Lead, Backend Engineer for our AI Software & Platform team, you will be responsible for lead the following:Provide technical leadership to all members of the team to guide designs and implementations towards optimal results with regard to reusability, security, reliability, and performance. Collaborate with various stakeholders to design complex systems comprised of multiple ML and non-ML services which meet the highest levels of security, performance, reliability, and scalability while satisfying requirements from within our own team plus those of external integrating teams. Collaborate with disparate teams to understand the operations of AI services and integrate them into our Generative AI products. Design and build effective interfaces between AI services, ensuring smooth communication and data exchange while adhering to security and performance requirements. Implement the right types of instrumentation to monitor and measure the performance, reliability, and security of integrated AI services. Debug integration issues, identifying bottlenecks or errors and implementing solutions to optimize service interactions. Work on performance tuning and optimization of the integrated AI services to ensure efficient and responsive operation. Develop clear and comprehensive documentation for integration processes, interfaces, and instrumentation, facilitating teamwork and knowledge transfer within the team. Collaborate closely with AI engineers, data scientists, and security experts to ensure smooth integration of AI services into the products. Ensure that integrated AI services meet security and compliance standards, working closely with the security team to implement necessary measures. Basic Qualifications 8 years experience as a Backend Engineer with expertise in integrating complex services . years experience writing code in Python, Java, or Go. BA / BS degree with 10 years of experience (or) MS degree with 8 years of experience as a software development engineer. Preferred Qualifications. Experience in AI service operations, including Generative AI, and the ability to design and build interfaces between them. Understanding of Gen. AI frameworks and orchestrators like Lang. Chain, Llamalndex, Semantic Kernel or Auto. Gen. Foundation in data structures and algorithms. Experience with instrumentation and monitoring tools for measuring service performance. Knowledge of compliance standards.