EleutherAI's OSS GPT-Neo reproduction
EleutherAI, “a grassroots collection of researchers working to open source AI research,” has scaled its open-source GPT-Neo implementation up to GPT-3 size. The weights are available to download for free, and you can play around with the pretrained models in an example Colab notebook. Yay open science! Now that I’ve run out of free GPT-3 credits on the OpenAI API, maybe I’ll be able to use this to generate new content for This Episode Does Not Exist! — drop me a message if you’d like me to try it out for your favorite podcast.