[HN Gopher] Connor Leahy on EleutherAI, Replicating GPT-2/GPT-3,... ___________________________________________________________________ Connor Leahy on EleutherAI, Replicating GPT-2/GPT-3, AI Risk and Alignment Author : antman Score : 42 points Date : 2022-02-06 18:59 UTC (4 hours ago) (HTM) web link (thegradientpub.substack.com) (TXT) w3m dump (thegradientpub.substack.com) | greatpostman wrote: | Seems like a pretty good way to get rich: | | 1. Raise money to train huge model, or just use 100k or so to | train it without raising vc | | 2. Train said model, no innovation required | | 3. Pump up the PR about releasing "worlds biggest model" | | 4. Profit | | If anyone wants to do this with me, I'm down | andreyk wrote: | If you actually listen to this or just know what EleutherAI is | (A grassroots collective of researchers working to open source | AI research), it's very evident that this is not their goal at | all | upwardbound wrote: | Aren't Eleuther's models libre and free though? | | https://www.eleuther.ai/faq/ | | > Are the codebases free software? | | GPT-Neo is MIT-licensed, while GPT-NeoX is licensed under | Apache 2.0. These are the most freely-termed licenses that we | can provide for each codebase respectively. | | Mesh Transformer JAX is licenced under Apache 2.0. | | > Are the models free software? | | EleutherAI is licensing models under Apache 2.0. If you use our | models, we would highly appreciate you citing or displaying | your usage of them. | mrfusion wrote: | If this is open source is there a good way to get involved? | andreyk wrote: | You can hop on their discord looks like | | https://www.eleuther.ai/faq/ | sillysaurusx wrote: | It was interesting to start the TPU Podcast discord server. I was | annoyed Connor showed up and convinced the talented researchers | to spend their time on his server. But now I get to claim | correctly that Eleuther never would have started without me, so | I'll put that up on the trophy shelf. Which happens to be next to | Shockley's trophy shelf, across the hall from MySpace. | | It was a wild and fun ride. I ended up becoming a published, | cited researcher thanks to Eleuther. | https://twitter.com/theshawwn/status/1480479272078913539?s=2... | | I've always wanted to do a postmortem writeup of my attempt at | starting an open source AI lab. It was always my goal from the | very moment I pressed the "create server" button, and it's at | least mildly interesting that it was successful -- in spite of my | efforts, not because of my efforts. | | I do feel a pang of jealousy every time I see an article like | this, and it would be nice if they'd occasionally link to our | server (https://discord.com/invite/x52Xz3y) rather than | mentioning it, but (with effort) I managed to transmute those | feelings into amusement. It would have been better if I felt | amused from day one. | andreyk wrote: | I'd recommend reading the blog post about their first year, it's | really fun and informative | | https://blog.eleuther.ai/year-one/ ___________________________________________________________________ (page generated 2022-02-06 23:00 UTC)