What they didn't tell you about Falcon 180b (and will it change?)

Опубликовано: 07 Февраль 2025
на канале: Nicholas Renotte
11,611
288

👨‍💻 Sign up for the Full Stack course and use YOUTUBE50 to get 50% off:
https://www.coursesfromnick.com/bundl...

🐍 Get the free Python course
https://go.coursesfromnick.com/python

Hopefully you enjoyed this video.
💼 Find AWESOME ML Jobs: https://www.jobsfromnick.com

🤖 Get the Code:https://github.com/nicknochnack/Falco...

Check out Falcon 180b the all new model from TII UAE.

Falcon 180b was released on the 6th of September 2023 by the TII UAE. It's a 180 billion parameter decoder only model that was trained on 3.5 billion tokens with a context window of 2048 tokens. What makes it unique is that it performs exceptionally well with the authors claiming it ranks just behind GPT4 and on par with Google’s PaLM 2 Large, in spite of being half the size of that model.

Oh, and don't forget to connect with me!
LinkedIn: https://bit.ly/324Epgo
Facebook: https://bit.ly/3mB1sZD
GitHub: https://bit.ly/3mDJllD
Patreon: https://bit.ly/2OCn3UW
Join the Discussion on Discord: https://bit.ly/3dQiZsV

Happy coding!
Nick