[HN Gopher] Pose Animator: SVG animation tool using real-time Te...
___________________________________________________________________
Pose Animator: SVG animation tool using real-time TensorFlow.js
models
Author : hardmaru
Score : 520 points
Date : 2020-05-09 14:06 UTC (8 hours ago)
(HTM) web link (github.com)
(TXT) w3m dump (github.com)
| BIackSwan wrote:
| This is freaking amazing. So many potential applications. Great
| work!
| pmayrgundter wrote:
| The annotated SVG skeleton is a separate download, but that
| server is out of quota :( Someone have it?
| yohann305 wrote:
| you can find about 5 svg skeletons inside the github's folder:
| resources/illustration/ Have fun
| scruffups wrote:
| Why is this down voted? I hate it when people do that and
| offer no explanation. Totally useless input, even harmful. HN
| should force comment on down-vote.
| dang wrote:
| Posting like this breaks the site guidelines. Would you
| please read them?
| https://news.ycombinator.com/newsguidelines.html
|
| One reason that guideline exists is that unfair downvotes
| frequently get canceled by users who come along, see the
| situation, and make a corrective upvote. Meanwhile
| complaints like this linger on in the thread, inaccurate
| and off-topic--they don't garbage-collect themselves. As an
| example, I noticed your other comment and upvoted it before
| I saw this comment here. Similarly, other users have
| upvoted the GP.
|
| As with any stochastic process, there is a lot of error and
| spillage with downvotes. There's no way to perfect it; you
| have to ask whether the system is better off with it than
| without it. Forcing comments wouldn't help, and posting
| complaints certainly doesn't help.
| scruffups wrote:
| Why not have a meta discussion like a Wikipedia Talk page
| so comments like these would have room and critique won't
| be shut down.
|
| Yesterday (you can look in my comment history) I ran into
| a situation where the person doing the down-voting turned
| out to be basing it on their opinion not fact (after they
| finally stated their opinion on the matter, which
| contradicts peer-reviewed research on the topic, I
| realized why they were down voting: insufficient depth of
| understanding of the topic) and no one came after them to
| correct the situation...
|
| Either have people explain why they down-voted or have a
| Talk page where people can discuss their reasons,
| complain, etc, behind the scene.
| dang wrote:
| HN is a site for intellectual curiosity (https://hn.algol
| ia.com/?dateRange=all&page=0&prefix=true&que...) and a
| meta forum would be a step away from that. It would fill
| up with bickering, nitpicking, litigating, and demands
| for bureaucratic administration--all things that
| intellectually curious discussion requires having the
| restraint to avoid.
| airstrike wrote:
| > HN should force comment on down-vote
|
| This is actually a great idea
| scruffups wrote:
| My other comment on this thread followed others in
| congratulating the author. It specifically said "Bravo!"
| and guess what? It got down voted.
|
| So the explanation may be that it is useless input but
| believe me it is not useless to the author to have people
| congratulate them for the fruit of their labor. It's a
| human desire to be recognized by others. How is it not a
| positive comment? Why down-vote something as benign and
| empathic as saying congratulations? So force a comment on
| each down-vote and things might get a little bit better
| because at least we'll know it's not just random acts of
| hostility and that the down-voter has a rational reason
| for it, at least in their mind.
| ngold wrote:
| Look forward to seeing this evolve. Very fun project.
| Commenting to save for later. Thank's.
| pmayrgundter wrote:
| Thanks, found 'em :)
| [deleted]
| [deleted]
| marcsto2 wrote:
| This is awesome!
| rw2 wrote:
| Wow, this would change how animation is done completely! If there
| existed an easy way to create animated character cartoons. It
| would launch a thousand southpark/rick and morty type of shows. A
| team with 10k can launch a show.
| dagmx wrote:
| The industry has had several tools like this for year's. it can
| be useful but it hasn't caught on in the past
| coderesearch wrote:
| please give us urls to other open source tools the industry
| uses for this kind of work, thank you very much.
| tyingq wrote:
| On the other hand, I expect a rash of poorly done "explainer"
| type videos coming.
| jjeaff wrote:
| Heh, literally my first thought when I saw the sample gifs
| was that I could use this to make some explainer videos. And
| yes, they would probably end up looking poorly done.
| jelling wrote:
| This is something I have been tracking for a few years now. If
| anyone is interested please DM me.
| nkozyra wrote:
| I believe Adobe has had this for a long time in character
| animator
|
| https://www.adobe.com/products/character-animator.html
| egypturnash wrote:
| Since 2015, according to Wikipedia.
| https://en.wikipedia.org/wiki/Adobe_Character_Animator
|
| They won an Emmy for it this year, their post about it
| (https://theblog.adobe.com/adobe-character-animator-
| receives-...) notes that it was used for a live broadcast of
| the Simpsons, and a Showtime series called "Our Cartoon
| President" (https://www.sho.com/our-cartoon-president).
| dharma1 wrote:
| Adobe Character Animator is not bad, has skeletal rigging and
| tracks mouth but doesn't do deformations like this one
| rw2 wrote:
| Good to know, it's a awesome feature I am surprised I don't
| see more successful shows made with this on reddit and
| youtube
| jjeaff wrote:
| That's because the animation is very much the least
| important part of a successful show. It's the writing and
| voice acting. South Park is a great example of this. It's
| successful because it is funny and edgy. The animation
| could have gone a lot of different ways and had similar
| success I think.
| rw2 wrote:
| I think fundraising is the hardest part of a project,
| especially for creatives. If a group of writers can
| wrangle some amateur voice actors to work, (Which I think
| would be the lowest paid actors) it should be easy to get
| a project up.
| nine_k wrote:
| Next step: output to a deep-fake synthesizer instead of SVG. Jump
| from animation to cinema.
| [deleted]
| p4bl0 wrote:
| It would be cool privacy-wise to have some sort of virtual webcam
| that could share such an animation rather than what the webcam
| actually sees.
| the8472 wrote:
| As a commercial solution there's facerig+live2d that already
| does that.
| sho_hn wrote:
| This is fairly easy to wire up on Linux using v4l2loopback and
| pyfakewebcam.
|
| I am currently using a little setup that uses OpenCV to acquire
| frames from the real camera, TensorFlow/BodyPix to compute an
| alpha mask for the foreground (me) and then OpenCV again to
| transform and composite myself behind news desks and into car
| infotainment screens and the like, eventually writing it to a
| virtual webcam I can use from Zoom (over its own virt bg
| feature this adds the layering and perspective transforms),
| Jitsi, Teams, etc.
|
| The above looks like another fun thing to add. Time to go full
| _Who Framed Roger Rabbit?_ ...
| sbarre wrote:
| Do you have any more details written up anywhere on how you
| do this? That sounds like a great project.
| njsubedi wrote:
| It sounds like a cool idea. Probably a platform to act on a
| play/script as the characters themselves? Like, a social
| theatre kind of thing with pre-animated background and stuff,
| where you only do your character part.
| p4bl0 wrote:
| Aha, that's a completely different application than what I
| had in mind (just an alt webcam that's better than a static
| picture for communication while still protecting your visual
| identity), but it would be amazingly cool =).
| phkahler wrote:
| OBS studio can do that.
| coderesearch wrote:
| Please more details - I can not find any feature on the OBS
| website similar to what we see here. Do we need some plugin /
| extension? Please give us some urls, thank you!
| GordonS wrote:
| This is a great idea! It should be great for bandwidth too -
| rather than sending full cam frames multiple times a second, it
| only needs to send deformation information describing
| movements.
| soylentgraham wrote:
| Hah that's what video compressors do!
| scruffups wrote:
| Bravo!
| runawaybottle wrote:
| Awesome, this is getting the idea mill in my head started.
| Animated short comics would be a great use case.
|
| Need some South Park vector models!
| ravila4 wrote:
| This is very cool! I wonder if using input from multiple cameras,
| plus a 3D rig can improve the accuracy of the rendering.
| ml_basics wrote:
| This is great! It's amazing to see what can be made out of open
| sourced machine learned building blocks
| iseanstevens wrote:
| This is great :) 10 years ago I'd been using Animata
| http://animata.kibu.hu + kinect, this rolls it all into one web
| based thing. cool stuff. Would it be easy to move it to a local
| GPU accelerated version for more FPS?
| soylentgraham wrote:
| Hmm tfjs does use the gpu, and there are plenty of small models
| for posenet to run fast on mobile. Maybe this is an old
| version. (Or maybe the bottleneck is in the face or svg stuff)
| But to answer your question, yeah it could be faster
| (everything could be faster given enough time! :)
| terpimost wrote:
| Great to see this thing open sourced. Adobe has a product for
| such things.
| nine_k wrote:
| At the level of fidelity of the demo, it's not yet a product.
|
| The demo is very promising, though.
| minxomat wrote:
| Also, cartoon animator 4 includes this, both using FaceID and
| RGB webcams.
| TazeTSchnitzel wrote:
| > This is not an officially supported Google product.
|
| Does that indicate the author is a Google employee who happened
| to make this in their free time, and has to say this somewhere by
| Google policy?
| jpalomaki wrote:
| "Unless your project is an official Google product, you must
| state "This is not an officially supported Google product" in
| an appropriate location such as the project's README file."
|
| https://opensource.google/docs/releasing/publishing/
| youeseh wrote:
| Maybe they used their 20% time on it.
| saadalem wrote:
| That's what a Side-Project should look like, curious to see the
| blog post !
| kevmo314 wrote:
| Awesome stuff! I was just looking at face-api.js the other day,
| this kicks it up a notch.
| airstrike wrote:
| I, for one, am ready for the metaverse
| hprotagonist wrote:
| do let me know when you've got a decent motorcycle model up and
| running.
| pmayrgundter wrote:
| Exactly :)
| mkchoi212 wrote:
| Wow really cool! I'm wondering how much work it is to define the
| specific anchor/interest points on the SVG for the correct
| mapping to occur.
|
| But I guess since "modern" illustrations are quite minimal, said
| work probably shouldn't take too long.
| ghego1 wrote:
| This is incredibly awesome
| zanybear wrote:
| I would really like this imposed on a Teams, Zoom, Lync,
| WebMeeting. This way you cam still be in pajamas...
| nitsky wrote:
| This is awesome! Great work, thanks for sharing.
| crazygringo wrote:
| This is like creating a live version of author drawings, e.g. of
| New Yorker contributors:
|
| https://www.newyorker.com/contributors
|
| How interesting would it be to have your own live emotionally
| expressive avatar for videoconferencing, when you don't want to
| worry about your hair, makeup, lighting, or general visual state
| at all?
| jfyne wrote:
| David Foster Wallace ruminated on this in Infinite Jest.
|
| "The proposed solution to what the telecommunications
| industry's psychological consultants termed Video-Physiognmoic
| Dsyphoria (or VPD) was, of course, the advent of High-
| Definition Masking. Mask-wise, the initial option of High-
| Definition Photographic Imaging -- i.e. taking the most
| flattering elements of a variety of flattering multi-angle
| photos of a given phone-consumer and, thanks to existing image-
| configuration equipment already pioneered by the cosmetics and
| law-enforcement industries -- combining them into a wildly
| attractive high-def broadcastable composite of a face wearing
| an earnest, slightly overintense expression of complete
| attention."
|
| Always thought it was fascinating that he came up with this in
| 1996!
| draugadrotten wrote:
| "You can look like a gorilla or a dragon or a giant talking
| penis in the Metaverse. Spend five minutes walking down the
| Street and you will see all of these. Hiro's avatar just looks
| like Hiro, with the difference that no matter what Hiro is
| wearing in Reality, his avatar always wears a black leather
| kimono. Most hacker types don't go in for garish avatars,
| because they know that it takes a lot more sophistication to
| render a realistic human face than a talking penis. Kind of the
| way people who really know clothing can appreciate the fine
| details that separate a cheap gray wool suit from an expensive
| hand-tailored gray wool suit.", Neil Stephenson, Snowcrash,
| 1992.
___________________________________________________________________
(page generated 2020-05-09 23:00 UTC)