MLX, Swift, and Apple AI with Vatsal Manot

Опубликовано: 18 Март 2025
на канале: Ray Fernando
373
14

Current State of Apple Tools

What we want to see at WWDC
Apple Intelligence (AI)
What is missing? Developer Tools?
Xcode assistant?
CoreML 2.0?

🕒 Key moments:
00:00 AI show intro
00:15 Introducing Vatsal Manot
00:45 Ray and Ronald's introductions
01:09 Discussing Apple's MLX
01:32 CoreML vs MLX frameworks explained
03:10 Neural Engine limitations
06:00 Deep dive into Neural Engine
09:00 Challenges of developing for Apple Silicon
11:30 Developer experience in Swift & ML
15:15 The Wild West of LLM development
19:55 Swift developer experience in local LLM inference
23:05 The fragmented state of Swift and ML
26:30 MLX Swift and its challenges
30:40 Current state of MLX and missing components
38:45 Introduction of Vatsal's company and tools
47:20 Tips for OpenAI users & future tools
52:55 Contacting Vatsal & community contributions
56:20 Visualizing embeddings in the Playground app
1:02:30 Discussion about converting models to MLX
1:16:15 Top three features for Apple's AI focus
1:23:55 Upcoming shows and guests