[HN Gopher] Stable Diffusion to 3D/WebVR, in the cloud, availabl... ___________________________________________________________________ Stable Diffusion to 3D/WebVR, in the cloud, available now Author : fbriggs Score : 33 points Date : 2022-10-25 21:50 UTC (1 hours ago) (HTM) web link (holovolo.tv) (TXT) w3m dump (holovolo.tv) | wellthisisgreat wrote: | It's weird how such an obvious marketing plug with subpar results | of 3D projection of 2D images got any traction here. I was baited | into clicking by seeing 3D/WebVR and was expecting 3D shapes like | the recent advancements, and saw.. well that | suyash wrote: | see no mention of stable diffusion, how is spam trending on HN | 1st page is surprising to me. | robflynn wrote: | Did you click the create button? It takes you to a page where | it specifically mentions stable diffusion and allows you to | create your own "vr image" with a prompt. | fbriggs wrote: | "A CYBERPUNK NINJA RIDING AN OSTRICH THROUGH THE STREET OF TOKYO" | https://holovolo.tv/v/962583 | | Today Lifecast unveils text-to-full 3D immersive environments | that can be viewed in VR (e.g., Quest 2) or on 2D screens. We are | doing this with a combination of Stable Diffusion and several | other neural nets to make it 3D, combined with Lifecast's format | for 6DOF VR photos and video. It's free to try and we do the | processing in the cloud. Check it out and tell us what you think! | This is version 1.0 and we are iterating quickly, so expect | improvements in the future. | bhaney wrote: | This looks... pretty terrible. The images being generated are | fine, but the conversion from 2D to 3D is awful. It looks like | something poorly lasso-tool'd around the subject, put it on | another layer closer to the viewer, and then very poorly | interpolated the space that's visible between the two layers when | you look at it from an angle. | | Am I missing something? I feel like I've seen much better | automatic 2D->3D conversions via layering long before this. | Firmwarrior wrote: | haha, sounds like you're describing every "3d" movie that came | out during the attempted 3D TV revolution in the 2010s | | The site looks cool to me, I think we're being a little | uncharitable to it. It runs at a high framerate and pans around | smoothly. If someone or a few people made this in their spare | time as a cool demo, it's great IMO | | If this is the result of $50,000,000's worth of research and | development, maybe it's worth a little scorn | kingkawn wrote: | Given how 2D looked even a few years ago I've got high hopes | for this | joewhatkins wrote: | This is just an off the shelf img2depth model run on top of | stable diffusion - I don't think there's a novel model or | research behind this. People have been doing the same thing | in colab for a while. | p1mrx wrote: | Maybe they accidentally trained the AI to fuck up the VR180 | camera projection? | | The left/right sides of every image contain a different, scaled | and rotated image. Some of the discontinuities are visually | pretty interesting. | joewhatkins wrote: | I think this is just created by running a depth prediction | model on the output of stable diffusion and then inserting | the relevant mesh into a 3D scene. The output of stable | diffusion isn't seamless by default, so those jumps will | happen. | supermatt wrote: | Im guess im not able to view the effect on desktop? Is it some | kind of depth segmentation of the generated images rather than | actual 3d? Maybe I need to view in a VR headset? | ajmurmann wrote: | Theis link from the OP seems to work well on desktop: | https://holovolo.tv/v/962583 | | That said, it looks like the ninja on the ostrich is a paper | cutout that just has different parallax scrolling and you can | still see the hole in the background it was cut out off. | reset-password wrote: | Looks great. Given all the progress around this on the open | source side I'm hoping that soon we'll be able to run something | like this at home. ___________________________________________________________________ (page generated 2022-10-25 23:00 UTC)