GenAI on the Edge Forum: On-Device Generative AI
On-Device Generative AI
Fatih PORIKLI, Sr. Director, Technology, Qualcomm Technologies, Inc.
Generative AI emerges as a transformative force, capable of creating new content such as text, code, images, video, audio, or other data, while handling complex dialogues and reasoning about problems. This disruptive technology is reshaping traditional approaches across various domains, from search algorithms and content creation to automation and problem solving, and redefining the user interface to computing devices. Its impact transcends industries, promising substantial advancements in utility, productivity, and efficiency. As the adoption of generative AI accelerates at an unprecedented pace, driving its computational demands to surge, on-device processing becomes more important than ever.
In this presentation, you’ll learn about:
The pivotal role of on-device AI deployment.
Full-stack AI optimizations to make on-device AI possible and efficient
Advanced techniques like distillation, quantization, and speculative decoding
How we deploy generative AI models on device with examples, including LVMs, LLMs, LMMs
Qualcomm Technologies’ role in scaling on-device generative AI
![OSU! [supercell - Hero Kowari's Insane] 4.42 FC S](https://images.videosashka.com/watch/l4DQHYtqzqY)
