[HN Gopher] Deep Learning Systems (CMU Course) ___________________________________________________________________ Deep Learning Systems (CMU Course) Author : __rito__ Score : 145 points Date : 2023-08-12 15:59 UTC (7 hours ago) (HTM) web link (dlsyscourse.org) (TXT) w3m dump (dlsyscourse.org) | a-dub wrote: | very nice! I'm also a big fan of the vu amsterdam deep learning | lectures on youtube. less systems focus but a really good intro | to modern neural network based ML. | amelius wrote: | Link: https://dlvu.github.io/ | junrushao1994 wrote: | This is a particular unique course offering introduction on ML | compilation and deployment :) | __rito__ wrote: | I really liked the style of the instructor (Kolter), and the | reason I like this course very much is because _each lecture is | followed by an implementation video along with the notebook | file_. | | In most Deep Learning courses, the implementation is left to | TAs and neither recorded nor made available. This course is an | exception. Another bright exception is NYU Deep Learning course | [0] by Yann LeCun and Alfredo Canziani. In that course, too, | all recitations ("Practica") are recorded and made available. | And Canziani is a great teacher. | | [0]: https://atcold.github.io/pytorch-Deep-Learning | lyapunova wrote: | I also really like the instructor for this course! | | Seems like he really cares. I looked him up and I guess he | was a student of Andrew Ng (the legendary ML lecturer!!) so | it makes sense. | borg16 wrote: | Thanks, this is a wonderful recommendation | [deleted] | abalaji wrote: | Took this class when it was offered for the first time when I was | at CMU--it's a really great course and well organized! | gdiamos wrote: | Excited to see the MLSys growing. | | Deep learning methods are so computationally intensive, many | advances have come through new algorithms and optimization | methods. | chefandy wrote: | I find open educational resources just so dang heartwarming. | smokel wrote: | I really like the sneers about some terrible naming, e.g. in the | slide on "The self-attention operation": | | _> "keys", "queries", "values", in one of the least-meaningful | semantic designations we have in deep learning_ | | And in the context of LSTMs: | | _> throwing in some other names, like "forget gate", "input | gate", "output gate" for good measure_ | | This makes me feel more confident about actually understanding | these topics. Before, I was totally misled by the awkward | terminology. | sva_ wrote: | It gets even worse when you see how the ML community likes to | bastardize terms from neuroscience. | | But I think it is good to have memorable names that one can use | to talk about the concepts verbally. | jeron wrote: | simply operator overloading ___________________________________________________________________ (page generated 2023-08-12 23:00 UTC)