[HN Gopher] AnimeGANv2: Convert Face Portraits into Anime
       ___________________________________________________________________
        
       AnimeGANv2: Convert Face Portraits into Anime
        
       Author : aliabd
       Score  : 124 points
       Date   : 2021-11-09 14:34 UTC (8 hours ago)
        
 (HTM) web link (huggingface.co)
 (TXT) w3m dump (huggingface.co)
        
       | wodenokoto wrote:
       | I thought the selfie to waifu generator created much more
       | interesting and anime like results.
       | 
       | It does look like it doesn't work anymore though.
       | 
       | https://waifu.lofiu.com/
        
       | coldacid wrote:
       | Tried a headshot of myself framed like the example pictures and
       | all I got was something that looked like it was bombed by effects
       | out of Paint.NET. Definitely looked nothing like an anime
       | character.
        
         | warning26 wrote:
         | Even the example pictures don't really look like anime, they
         | just look like some kind of unrealistic "drawing" filter.
        
       | messo wrote:
       | The example with Bill Gates at the bottom is wild! The "teardrop"
       | under one of his eyes makes it slightly gangster, and the smooth
       | face and awkward smile reminds me of a much younger Bill.
       | Fascinating.
        
       | chillingeffect wrote:
       | at first the result disappointed me (emotionally, not
       | technically), but after a few minutes I went back to it and was
       | struck by the feel the image brought out. It really reflected
       | some of the wistfulness and sadness I feel with a tiny touch of
       | optimism. I'm not well-versed in anime, but that does seem to be
       | a little bit of the feel that I get from it. bravo.
        
       | bobobob420 wrote:
       | Unless this is open source and I can run all of the code locally
       | with no internet connection I am not doing this. Am I too
       | paranoid?
        
         | ShamelessC wrote:
         | It is and you can.
        
       | webmaven wrote:
       | Like many other comments, I don't see much resemblance to anime
       | styles, but dismissing the results as a Photoshop filter is nuts.
       | 
       | The animation style this does look like is that of 2006's A
       | Scanner Darkly, or 2019's Undone.
        
         | MisterTea wrote:
         | > The animation style this does look like is that of 2006's A
         | Scanner Darkly, or 2019's Undone.
         | 
         | Rotoscoping is the technique. Basically, you film real life and
         | trace over the frames by hand yielding an animated version of
         | your irl footage.
        
           | erichocean wrote:
           | The first animated films to do this were the animated LOTR
           | film and _Fire and Ice_ shortly thereafter, both by the same
           | director.
           | 
           | Logically, very similar during production to how _Avatar_ was
           | made, but doing the rendering  "by hand" (and being unable to
           | change the camera after capture).
           | 
           | Pretty impressive results given the budget and time
           | requirements.
        
             | webmaven wrote:
             | _> The first animated films to do this were the animated
             | LOTR film and Fire and Ice shortly thereafter, both by the
             | same director._
             | 
             | Although rotoscoping is a venerable technique, the results
             | we're looking at with this service don't bear much
             | stylistic resemblance to early works like Fire and Ice or
             | Snow White and the Seven Dwarfs (or more recent rotoscoped
             | works like The Little Mermaid either). If they did, I'd
             | have given them a pass on the 'anime' claim, even though
             | calling the Disney house style -- or Bakshi's -- 'anime' is
             | still a stretch.
        
             | Pxtl wrote:
             | Actually while Bakshi was the first to make a movie that
             | went all in on rotoscoping (particularly Fire and Ice where
             | it was 100% rotoscoped while LOTR was a mixed bag) the
             | first animated film to heavily leverage rotoscoping was
             | Snow White.
        
             | wodenokoto wrote:
             | There was a lot of rotoscoping going on in Disney's
             | Snowwhite
        
       | bj-rn wrote:
       | Remided me of "Waifu Synthesis- real time generative anime":
       | http://everyoneishappy.com/portfolio/waifu-synthesis-real-ti...
        
       | peterthehacker wrote:
       | Tried with Elon and Gates, but both threw this error
       | Error occured while trying to proxy: hf.space/
        
         | aliabd wrote:
         | Sorry, we had to restart the interface for a separate issue.
         | Please try again
        
       | dryst wrote:
       | Lol @ the Bill Gates to middle aged woman with teardrop tattoo.
        
       | snvzz wrote:
       | A gallery of examples would be nice.
       | 
       | Else, it's too much effort. People are gonna just close the
       | browser tab, like I did.
        
         | aliabd wrote:
         | You're right, see 100s of examples posted by users here:
         | https://twitter.com/ak92501/status/1457033482115420160/retwe...
        
           | villasv wrote:
           | Those definitely don't look like the anime I watch
        
             | hiccuphippo wrote:
             | Yes, Anime has many different kinds of aesthetics but not
             | what this generates. Perhaps it should be renamed
             | PaintingGAN or CartoonGAN?
        
               | jackorange wrote:
               | Surely the primary reason for the name is much fewer
               | people would click and share otherwise. It's clickbait
               | with software.
        
             | jackorange wrote:
             | Right, I don't see the "anime" part. This just looks like
             | one of the thousands of nameless photo editing software
             | filters.
        
           | l33tman wrote:
           | To be honest, it looks pretty weird... the eyes are
           | asymmetrical..
           | 
           | The Snap filter that does something similar to this looks
           | much better, is live, and doesn't use a ton of deep learning
           | I think :)
        
           | zinclozenge wrote:
           | I guess it's impressive you can train a network to do that,
           | but it doesn't look much better than a photoshop filter.
        
             | handrous wrote:
             | Now that AI figured out how to press the "posterize"
             | button, the singularity is surely just around the corner.
             | 
             | Yeah, glad there were examples, saved me trying it. Results
             | are nowhere close to what I expected. Zero of them looked
             | like anime at all, for one thing. Many truly did look like
             | one or two basic Photoshop filters had been applied, and
             | that was it.
        
             | onion2k wrote:
             | _I guess it 's impressive you can train a network to do
             | that, but it doesn't look much better than a photoshop
             | filter._
             | 
             | I'm not sure if you're saying it's bad because you're
             | underestimating how powerful some Photoshop filters are, or
             | if you're saying it's good because you aren't.
        
             | civilized wrote:
             | The Squid Game one looks kind of okay but the rest are
             | uninspired.
        
               | bnjms wrote:
               | There is one further down for a Comic-Con and it looks
               | really good. The rest less so. But it's a good filter.
        
         | sschueller wrote:
         | Waisted resources by not providing pre rendered versions of the
         | 7 examples. I had to wait 3 minutes to render one.
        
       | ur-whale wrote:
       | I'd be curious to see how well / stable this behaves under
       | animation.
        
         | zellyn wrote:
         | Found this under that twitter thread mentioned above:
         | https://twitter.com/AIconference/status/1457622949901574149
        
           | ALittleLight wrote:
           | That's really good. I could see this being a popular filter.
        
       | remram wrote:
       | Waited 10min then got an error.
        
         | Minor49er wrote:
         | Same for me
        
         | aliabd wrote:
         | Sorry we had to restart the interface - can you try again?
        
       | codein wrote:
       | Did not manage to get any result. Is the service down?
        
       | TulliusCicero wrote:
       | Interesting, you can see how it feminizes faces quite clearly in
       | the examples of Bill Gates and Elon Musk. Gates looks kind of
       | like Ellen DeGeneres to me in the anime version.
        
       | kroltan wrote:
       | Great, now I can generate random cartoon portraits by combining
       | this with https://www.thispersondoesnotexist.com/
       | 
       | I do second the observation that this isn't nearly "Anime" style
       | by any definition or sample of the style I've ever seen. I would
       | expect to see these results in a GTA 5 loading screen.
        
       | Pxtl wrote:
       | Ugh, it doesn't properly respect EXIF rotation tags so if I try
       | to post from my phone it gets mangled. EXIF rotation has got to
       | be the most absurdly poorly supported feature of a common file
       | type like jpeg.
        
       | aliabd wrote:
       | This was built on top of the Pytorch implementation [0] of
       | AnimeGANv2, using gradio [1] and HuggingFace Spaces [2]. See the
       | 100s of examples [3] posted by users.
       | 
       | [0]: https://github.com/bryandlee/animegan2-pytorch [1]:
       | https://gradio.app [2]: https://huggingface.co/spaces [3]:
       | https://twitter.com/ak92501/status/1457033482115420160/retwe...
        
         | karaterobot wrote:
         | Does the app keep any data after generating the image?
        
           | aliabd wrote:
           | Nothing is saved by default. Clicking 'flag' saves the input
           | and output (only accessible to the space owner). More info on
           | flagging: https://gradio.app/getting_started/#flagging
        
       | amelius wrote:
       | Nice, but the problem I have with this and similar techniques is
       | that if you zoom out sufficiently far, then you don't see a
       | difference with the original image. This is not how "anime" is
       | supposed to work.
        
         | fxtentacle wrote:
         | Yes, it learns to replace the high-frequency features while
         | leaving low frequencies intact, just like all those other style
         | transfer CNNs.
        
       | ksec wrote:
       | May be those examples should have instant results? I guess most
       | people are just clicking them to see what it looks likes instead
       | of waiting 100s.
       | 
       | Most of them look like photoshop filter as per other comments,
       | but IU and Billie Eilish definitely looks good.
        
         | cinntaile wrote:
         | People keep stating these look like photoshop filters. This is
         | a very shallow dismissal imo. Why don't you prove it instead by
         | applying some Photoshop filters and achieving a similar effect?
         | Include how long it took as well.
        
       | GhettoComputers wrote:
       | Who decided this was anime? It doesn't look like any anime I have
       | ever seen, it just looks like a smoothing filter. It looks more
       | like a toonme but not as good and maybe more private? For
       | referece look at this waifu generator, nobody would call these
       | portrait conversions anime. http://thiswaifudoesnotexist.com/
        
       ___________________________________________________________________
       (page generated 2021-11-09 23:00 UTC)