[HN Gopher] Freewire: An Experiment with Freely Wired Neural Net... ___________________________________________________________________ Freewire: An Experiment with Freely Wired Neural Networks Author : optimalsolver Score : 34 points Date : 2021-03-18 09:25 UTC (1 days ago) (HTM) web link (github.com) (TXT) w3m dump (github.com) | mpoteat wrote: | If freely wired neutral networks are DAGs, I wonder how cyclic | graphs of neurons behave, or even if that model would be | theoretically meaningful, or computationally feasible. | goldenkey wrote: | https://en.wikipedia.org/wiki/Boltzmann_machine | | You generally run them until they settle down. You can train | them, in a difficult process, by using the idea of thermal | equilibrium. | LeegleechN wrote: | Yep, they've existed for decades. Look up "RNN" (recurrent | neural network) and "LSTM" (long stort-term memory). They were | the standard for neural-network based time-series processing | for a while until recently supplanted by Transformers. | ttul wrote: | Can anyone link to a recent paper discussing the benefits or | advantages of freely wired networks vs. prescribed networks? | nujrabes wrote: | Haven't heard the term "freely wired" before, but FAIR released | an exploration of randomly wired neural networks which seems | conceptually similar. https://arxiv.org/abs/1904.01569 ___________________________________________________________________ (page generated 2021-03-19 23:01 UTC)