ODSC West 2023: MLOps Keynote Implementing Gen AI in Practice

Опубликовано: 12 Май 2025
на канале: Iguazio (Acquired by McKinsey)

212

In this talk, we cover the necessary foundations for Gen AI use cases and how to build an ‘AI Factory’ that will enable you to continuously roll out new Gen AI applications, based on 3 real world examples:

1. Creating a Virtual SME (Subject Matter Expert)
Fine-tuning an LLM to become a subject matter expert on your area of choice, creating an app that can supplement your marketing, customer service or support channels.
2. Using Gen AI to build a Smart Customer Call Center Analysis App
Building an app that analyzes customer calls at scale, providing information such as the call topic and whether the customer's issue was successfully resolved, and including important aspects such as PII (Personal Identifiable Information) removal.
3. Building an Intelligent Chatbot with LLMs
Building an intelligent chatbot for customer service, to use as a virtual agent, or for eneral Q&A, including application information, validation and stateful classification.
Creating a chatbot that can understand the nature of the request, extract the right parameters, route it accordingly to the relevant application, validate and monitor it, format and save its state for the next inquiry.