[HN Gopher] The many ways that digital minds can know - A better... ___________________________________________________________________ The many ways that digital minds can know - A better way to think about LLMs Author : moultano Score : 37 points Date : 2023-07-05 17:17 UTC (5 hours ago) (HTM) web link (moultano.wordpress.com) (TXT) w3m dump (moultano.wordpress.com) | troft wrote: | [dead] | turnsout wrote: | Nice article, and I like the choice of the word "integration" | rather than "generalization" to describe the ability of a model | to take an internal representation and apply it in a new | scenario. | | I continue to think that Relational Frame Theory [0] both | explains _why_ these models work so well, and also _how_ they 're | able to integrate knowledge through nothing but language. I | believe that a researcher could show that LLMs emergently encode | "frames" that describe relationships between concepts; that | frames can be combined to form more complex expressions; and that | frames can be reused in different contexts to make "novel" | connections. | | [0]: https://en.wikipedia.org/wiki/Relational_frame_theory ___________________________________________________________________ (page generated 2023-07-05 23:01 UTC)