Join Chris Fregly as he explores Apple's new on-device and server foundation models. Discover Apple's commitment to Responsible AI, differential privacy, and federated learning. Learn about the lifecycle of foundation models, ranging from pre-training with vast datasets to post-training optimizations like quantization and LoRA Adapters. Dive into advanced training strategies using AXLearn, and see how Apple's models perform against competitors. This comprehensive overview highlights innovative techniques ensuring security, privacy, and efficiency. Don't miss out on these groundbreaking advancements in AI technology.
00:00 Introduction and Overview
00:19 Responsible AI and Privacy
00:48 Foundation Model Lifecycle
01:14 Data Collection and Training
02:16 Post-Training and Optimization
03:52 Evaluation and Benchmarking
04:43 Conclusion and Future Outlook