GPT 4 can self-correct and improve itself. With exclusive discussions with the lead author of the Reflexions paper, I show how significant this will be across a variety of tasks, and how you can benefit.
I go on to lay out an accelerating trend of self-improvement and tool use, laid out by Karpathy, and cover papers such as Dera, Language Models Can Solve Computer Tasks and TaskMatrix, all released in the last few days.
I also showcase HuggingGPT, a model that harnesses Hugging Face and which I argue could be as significant a breakthrough as Reflexions. I show examples of multi-model use, and even how it might soon be applied to text-to-video and CGI editing (guest-starring Wonder Studio). I discuss how language models are now generating their own data and feedback, needing far fewer human expert demonstrations. Ilya Sutskever weighs in, and I end by discussing how AI is even improving its own hardware and facilitating commercial pressure that has driven Google to upgrade Bard using PaLM.
Reflexion Results: https://github.com/GammaTauAI/reflexion-human-eval
Karpathy Tweet: https://twitter.com/karpathy/status/1640042620666920960
Reflexion GPT 4 Post: https://nanothoughts.substack.com/p/reflecting-on-reflexion
Reflexion paper: https://arxiv.org/abs/2303.11366
Sparks Report: https://arxiv.org/pdf/2303.12712.pdf#page=21
GPT 4 Technical Report: https://arxiv.org/pdf/2303.08774.pdf
DERA Dialogue: https://arxiv.org/pdf/2303.17071v1.pdf
Language Models Can Solve Computer Tasks: https://arxiv.org/pdf/2303.17491.pdf
TaskMatrix Paper: https://arxiv.org/pdf/2303.16434.pdf
Language Models Can Self-Improve: https://arxiv.org/pdf/2210.11610.pdf
Wonder Studio: https://twitter.com/WonderDynamics/status/1633627396971827200
Alpaca Paper: https://crfm.stanford.edu/2023/03/13/alpaca.html
Ilya Interview: https://www.youtube.com/watch?v=Yf1o0TQzry8&t=997s
Reuters Nvidia: https://www.reuters.com/technology/nvidia-shows-new-research-using-ai-improve-chip-designs-2023-03-28/
Bard Upgrade: https://www.nytimes.com/2023/03/31/technology/google-pichai-ai.html