[HN Gopher] Show HN: Search inside YouTube videos using natural ... ___________________________________________________________________ Show HN: Search inside YouTube videos using natural language queries Author : vladoh Score : 32 points Date : 2021-02-12 21:29 UTC (1 hours ago) (HTM) web link (github.com) (TXT) w3m dump (github.com) | vladoh wrote: | This is a demonstration of the abilities of OpenAI's CLIP neural | network. The tool will download a YouTube video, extract frames | at regular intervals and precompute the feature vectors of each | frame using CLIP. | | You can then use natural language search queries to find a | particular frame of the video. The results are really amazing in | my opinion... | | If you want to experiment with it yourself, I prepared a Colab | notebook that can easily be run: | https://colab.research.google.com/github/haltakov/natural-la... | pininja wrote: | This is very cool! Does this produce a occurrence index by any | chance? It would be neat to explore a word map of a video. | vladoh wrote: | Not yet, but I had this idea as well. You basically get a | score describing how well a phrase is matching each of the | images so it won't be difficult to do. I'll look into that! | purplecats wrote: | notebook isn't loading for me but this seems really cool | vladoh wrote: | Hmm, this is strange... The Colab notebook should load even if | you are not logged in with your Google account (you will need | to log in if you want to run it, though). ___________________________________________________________________ (page generated 2021-02-12 23:00 UTC)