[HN Gopher] EleutherAI One Year Retrospective
___________________________________________________________________
EleutherAI One Year Retrospective
Author : tehsauce
Score : 70 points
Date : 2021-07-08 18:59 UTC (4 hours ago)
(HTM) web link (blog.eleuther.ai)
(TXT) w3m dump (blog.eleuther.ai)
| nynx wrote:
| Sounds like a fun place to hang out!
| Rebelgecko wrote:
| Can anyone elaborate on Bruder muss loss?
| siekmanj wrote:
| It's a German phrase which colloquially translated means 'Gotta
| go bro'
| robbedpeter wrote:
| https://knowyourmeme.com/memes/pedalo In german, "Brother must
| go!"
| albertgoeswoof wrote:
| So MS invested $1bn into OpenAI. Meanwhile, these volunteers
| built an OSS version of OpenAI's flagship product in their spare
| time.
|
| Can you imagine if we could redirect funds to actual OSS
| developers at scale?
| Tenoke wrote:
| What they did is cool and impressive but that's an extreme
| oversimplification.
|
| Building a small version of something that already exits, has
| code you can look at (gpt2), paper etc. is going to always be
| cheaper and easier even if we ignore that OpenAI work on and
| publish more than gpt. This is before even mentioning that they
| have an enormous amount of free compute from Google (and
| others) while Azure credits is a lot of what the 1bn investment
| to OA included.
| Eridrus wrote:
| This is clearly true, but this is also far cheaper that we
| could get this capability if we were to really staff a
| project.
|
| If there are volunteers who are capable of and want to
| contribute to the information commons and are merely
| constrained by compute, we should clearly help them.
| king_magic wrote:
| This was an entertaining read.
| syntaxing wrote:
| Where does the EleutherAI computing resource and the money
| required to pay for it come from?
|
| Edit: I think they got a grant from the TPU Research org
|
| [1] https://sites.research.google/trc/
| Tenoke wrote:
| As it says in the post the free compute from Google's TFRC and
| also a collaboration with Coreweave who pledged more.
| syntaxing wrote:
| Missed it when I was skimming the article but saw a reference
| to them in the repo
| Tenoke wrote:
| Also for what is worth TFRC is not really a grant grant.
| You just sign up and if they like you they give you access.
| ma2rten wrote:
| I think they do ask you what you are planning to use the
| resources for, what your qualifications are and make a
| decision to allocate and how many tpus based on that.
| Tenoke wrote:
| Yes, they do but it's not really a grant and they don't
| really follow up on what you do unless you contact them
| yourself. You just fill a form and if you get accepted
| get an email later with access. At least that's how it
| was when I got accepted but things might've changed since
| last I've heard.
| sillysaurusx wrote:
| Apply to TRC! You personally can get the same computing
| resources. https://blog.gpt4.org/jaxtpu
|
| For some reason, everyone is reluctant to apply. I wrote that
| to dispel some of the hesitation. Wanting to play with TPUs is
| a fine reason to join.
|
| Some reasons why TRC is awesome:
| https://news.ycombinator.com/item?id=27728225
___________________________________________________________________
(page generated 2021-07-08 23:00 UTC)