[HN Gopher] Automatic supercuts on the command line with Videogrep
___________________________________________________________________
Automatic supercuts on the command line with Videogrep
Author : saaaam
Score : 168 points
Date : 2022-05-23 19:02 UTC (3 hours ago)
(HTM) web link (lav.io)
(TXT) w3m dump (lav.io)
| r-k-jo wrote:
| Hi Sam, I'm big fan of your work! Coincidently, I just made a
| simple POC video editor by editing text using this speech to text
| model
| https://huggingface.co/facebook/wav2vec2-large-960h-lv60-sel....
| It might be cool to integrate into your Videogrep tool, it also
| works offline with CPU or GPU, and gives you timestamps for word
| or character level.
|
| https://twitter.com/radamar/status/1528660661097467904
| saaaam wrote:
| Thank you! I will definitely take a look at that - looks great.
| woudsma wrote:
| Very nice project!
|
| Would be cool if it didn't need a .srt file, but that it would
| scan the audio for a search prase.
|
| Edit: Never mind, I see that you can create transcriptions using
| vosk!
| saaaam wrote:
| Yes, and vosk is really amazing...
| sharkmerry wrote:
| See section on Transcribing
| sharpshoot wrote:
| You can search inside video using phrases on muse.ai -- see
| examples for TED talks https://muse.ai/demo-embed-search-ted or
| yc startup school https://muse.ai/demo-embed-search-uni
| filmgirlcw wrote:
| This is awesome! I've considered building something nearly
| identical over the years, as I've definitely used VTT files to
| aid in searching for content to edit, but never did because
| getting all the FFmpeg stuff to work made my head hurt. I'm so
| glad someone else has done the hard work for me and that it's
| been documented so well!
|
| Love this.
| saaaam wrote:
| Thank you! And it's using moviepy to make the cuts (which is
| technically speaking the actual hard part).
| filmgirlcw wrote:
| oh awesome! Very, very cool!
| OJFord wrote:
| Has Zuckerberg _deliberately_ had work /make-up done to look like
| his own avatar might in some sort of 'metaverse' world? I can't
| be alone in thinking a lot of those clips look more like gameplay
| footage than photography?
| [deleted]
| aktuel wrote:
| WTF is a supercut. ...OK apparently it means cutting a number of
| parts from the source video containing a given spoken text and
| joining them together again. Still not sure why you would call
| that a supercut.
| appletrotter wrote:
| Disapproval registered!
| arboles wrote:
| Cut Cut Cut Cut Cut Cut Cut Cut Cut Cut Cut Cut Cut Cut Cut Cut
| Cut Cut.
| tmaly wrote:
| https://www.supercuts.com/
| bovinegambler wrote:
| https://en.wikipedia.org/wiki/Supercut
| marci wrote:
| Let me enhance the wiki definition
|
| https://www.youtube.com/watch?v=LhF_56SxrGk
| xn wrote:
| Enjoying the serendipity of finding the right tool at the right
| time: https://twitter.com/xn/status/1528845032438083584
| sergiotapia wrote:
| Super niche but this would be great to build a comprehensive clip
| archive of the genovaverse.
|
| Search by text, generated videos of frequent phrases and other
| meme-worthy sayings from the Sith Lord.
|
| What do you think about that DALE?
| rektide wrote:
| Resounding notions of Object Oriented Ontology[1] in Cinema[2][3]
| here, which is very much about pick out & possibly stitching
| together key items from film.
|
| > " _All of the elements of a shot's mise en scene, all of the
| non-relational objects within the film frame, are figures of a
| sort. The figure is the likeness of a material object, whether
| that likeness is by-design or purely accidental. A shot is a
| cluster of cinematic figures, an entanglement. Actors and props
| are by no means the only kinds of cinematic figures--the space
| that they occupy and navigate is itself a figure "_
|
| And the words they say, as seen here.
|
| [1] https://en.wikipedia.org/wiki/Object-oriented_ontology
|
| [2] https://larvalsubjects.wordpress.com/2010/05/03/cinema-
| and-o...
|
| [3] https://sullivandaniel.wordpress.com/2010/05/02/film-
| theory-...
| giberson wrote:
| Any thought on providing an option to make a super cut that
| produces a desired output?
|
| Ie `videogrep --input *.mp4 --produce "I am a robot"` and will
| find all the pieces it needs to produce the desired output?
| saaaam wrote:
| Yes that's possible, but the results are usually not so great!
| krat0sprakhar wrote:
| The YouTube video linked in that post
| (https://www.youtube.com/watch?v=nGHbOckpifw) is probably the
| most hilarious thing I'll see this week. Thank you for sharing
| that.
|
| Also is Zuckerberg for real? Half of those snippets look like it
| is a NPC from from a game. -\\_(tsu)_/-
| [deleted]
| vaughan wrote:
| I always wanted a markdown-like video editor. I want to chop up
| my videos and make notes about what is in them.
|
| Text based document would be so much easier for this than big
| clunky Premiere.
| BolexNOLA wrote:
| No markdown but have you played with Descript?
| mmanfrin wrote:
| The short clip showing the results of searching for 'ing' words
| caught me so off guard. I have the humor of a 12 year old.
| mh- wrote:
| Even with your warning, I have to admit I giggled.
| abathur wrote:
| Exciting!
|
| Back in 2011-12, my MFA (poetry) thesis project was a sort of
| poetic ~conversation between myself, and (selected) poems
| generated by a program I wrote, using transcripts of Glenn Beck's
| TV show.
|
| I really, _really_ wanted to be able to generate video
| ~performances of the generated poem in each pair for my thesis
| reading (and for evolving the project beyond the thesis). I have
| to imagine videogrep could support that in some form, at least if
| I had the footage. (Not that I want to re-heat that particular
| project at this point).
|
| Great work.
| saaaam wrote:
| amazing - would love to see that!
| aantix wrote:
| Are there any additional annotations that would be available?
| Identifying objects in the scene, sentiment or tone of speech,
| etc?
| harel wrote:
| The Donald Trump video made me laugh-out-loud for real like we
| used to do in the 90s.
___________________________________________________________________
(page generated 2022-05-23 23:00 UTC)