AI: How to code Chat GPT from scratch?
Hi we all know how cool ChatGPT is and what amazing things it can do, so we thought how cool it will be to create your ChatGPT right?
ChatGPT is a chatbot launched by OpenAI in November 2022. It is built on top of OpenAI's GPT-3.5 family of large language models, and is fine-tuned with both supervised and reinforcement learning techniques.
Both approaches used human trainers to improve the model's performance. In the case of supervised learning, the model was provided with conversations in which the trainers played both sides: the user and the AI assistant. In the reinforcement step, human trainers first ranked responses that the model had created in a previous conversation.
Chat GPT uses transformers neural networks, these are special kinds of neural networks which are good at generating text. you can train transformer neural network with large dataset of text
In this video we used GPT-2 to create converstation chat bot.
#artificialintelligence #chatgpt #transformers #neuralnetwork #machinelearning #coding #programming #openai #elonmusk #ai #ml #software #softwareengineer #computerscience #ai #gpt3 #datascience #datascientist
