[HN Gopher] AlphaCode Attention Visualization
___________________________________________________________________
AlphaCode Attention Visualization
Author : MurizS
Score : 37 points
Date : 2022-12-08 21:54 UTC (1 hours ago)
(HTM) web link (alphacode.deepmind.com)
(TXT) w3m dump (alphacode.deepmind.com)
| ladon86 wrote:
| For context on what this is, here is the associated blog post:
| https://www.deepmind.com/blog/competitive-programming-with-a...
| dang wrote:
| One previous thread:
|
| _Competitive Programming with AlphaCode_ -
| https://news.ycombinator.com/item?id=30179549 - Feb 2022 (397
| comments)
| [deleted]
| johnthuss wrote:
| "As part of DeepMind's mission to solve intelligence, we created
| a system called AlphaCode that writes computer programs at a
| competitive level. AlphaCode achieved an estimated rank within
| the top 54% of participants in programming competitions by
| solving new problems that require a combination of critical
| thinking, logic, algorithms, coding, and natural language
| understanding."
| pifm_guy wrote:
| Worth noting that in many programming competitions online, a
| large chunk of competitors either don't submit anything, or
| only submit a little example.
| tromp wrote:
| Will we ever see the day when AlphaIOCCC submits a winning entry?
| jw1224 wrote:
| Has Google/Alphabet publicly released any of their AI models yet?
| I've seen plenty of hype surrounding Imagen [1] and Parti [2],
| but as far as I know, they're still vaporware.
|
| Normally I wouldn't think too hard about this, but two things
| come to mind here:
|
| Firstly, the speed at which competitors are launching and
| developing new AI models. Imagen/Parti both seem to rival Stable
| Diffusion and DALL-E... why can't we use them yet?
|
| Secondly (and perhaps this is clouding my judgment), the fact a
| Midjourney founder mentioned during an Office Hours session that
| [paraphrasing]: "it's widely known in the industry that 90% of AI
| research is completely made-up garbage"...
|
| [1] https://imagen.research.google/
|
| [2] https://parti.research.google/
| [deleted]
| jiggawatts wrote:
| The cultures at the various leading AI research organisations
| are wildly divergent.
|
| Google is full of people that for a want of a better word are
| simply arrogant. They think that the purpose of AI is for them
| to show off their skills and... that's it. At best they'd use
| it internally for selling you more ads, they don't seem to
| think other people are _worthy_ of using the output of their
| efforts in any shape, way, or form.
|
| OpenAI is full of boyscouts that think that AI should be
| carefully censored so that it represents black, brown, asian,
| and white people equally. They deliberately skew the training
| data to enshrine wokeness into the product, while also trying
| to prevent anyone using their models to generate anything
| vaguely like porn. Basically, they're digital mormons. No fun.
|
| Stability AI / Stable Diffusion is a bunch of people that had
| money thrown at them with no guard rails. Anything goes.
| Download our models and have fun! Make porn if you want to.
| Whatever.
|
| To nobody's surprise, only the latter is of any interest or use
| to the general public.
|
| The sad part is that Google had the most resources to spend on
| training their models, and it's the least accessible.
|
| It's like Tony Stark inventing cold fusion energy and then
| using only to power his suit instead of... you know...
| _changing the world for the better_.
| alphabetting wrote:
| _Google is full of people that for a want of a better word
| are simply arrogant. They think that the purpose of AI is for
| them to show off their skills and... that 's it. At best
| they'd use it internally for selling you more ads, they don't
| seem to think other people are worthy of using the output of
| their efforts in any shape, way, or form._
|
| I don't think the papers they put out are to "show off." It's
| for advancing the entire field. Imagine if they had kept the
| Transformer paper in house which everyone uses and is
| basically the standard in AI now. AI wouldn't be anywhere
| close to where it is today. Also, I think it's a little
| ridiculous to think Google would spend $100B over the past 10
| years on AI research and not think this stuff will be seen in
| important products.
___________________________________________________________________
(page generated 2022-12-08 23:00 UTC)