[HN Gopher] Genie: Text to 3D in Seconds
___________________________________________________________________
Genie: Text to 3D in Seconds
Author : tancik
Score : 34 points
Date : 2023-11-02 19:32 UTC (3 hours ago)
(HTM) web link (lumalabs.ai)
(TXT) w3m dump (lumalabs.ai)
| aogaili wrote:
| Landing page is awesome, wonder how it was created
| kleiba wrote:
| Is that sarcasm?
| smokel wrote:
| Probably not, there is an impressive interactive 3D point
| cloud rendering, which only shows up after a few seconds.
| Perhaps you missed that?
| tedunangst wrote:
| How many seconds? I see a discord button, and then some
| weird blob thing wobbling around. After 30 seconds I got
| bored of watching it.
| Karliss wrote:
| In that case you didn't miss anything. Weird wobbling
| blob thing is the "impressive interactive 3D point
| cloud".
| haxiomic wrote:
| You should be able to see the blob form models - perhaps
| there's some error when it runs on your system. It relies
| on floating-point textures which aren't supported
| everywhere
|
| If you view this link https://lumalabs.ai/genie?s=1&d=-4,
| do you see the models more clearly?
|
| If you _don't_ I'd be curious if any errors are reported
| in console
| Karliss wrote:
| Yes with s=1?d=-4 the models are completely clear. I
| assume the semitransparent glittery look is intentional
| artistic choice."weird blob" weren't my words but I can
| imagine how someone could describe it that way
| considering that half of the time you see the transition
| animation during which it's much harder to recognize the
| object.
| aogaili wrote:
| It's not, I was referring to the interactive 3D author
| explained.
| haxiomic wrote:
| Thank you! I worked on this
|
| We start with a point cloud generated from the model which has
| color and normal and render each particle as a little hexagon
| with metallic and iridescent shading. Each particle is given a
| position and velocity in a texture. Each frame we do a physics
| step that writes to these textures with fragment shaders. We
| sum the forces into the velocity texture:
|
| - mouse interaction force
|
| - flow force from time varying curl noise
|
| - spring force to return to original position
|
| - air resistance
|
| last we do a euler step to update position texture. There's
| masses of free parameters to control forces and materials, the
| animation is created by changing parameters per-particle over
| time
|
| Tip: Left click to push apart, right click to pull together!
| dgellow wrote:
| Any way to try out without discord?
| asynchronous wrote:
| I hate this business model.
| tancik wrote:
| Non-discord interfaces in the pipeline!
| Karliss wrote:
| For those not wanting to touch discord here are some better:
| https://lumalabs.ai/genie?one=11eeebfc-de82-4bec-9c65-1eae57...
| https://lumalabs.ai/genie?one=6bc23542-c2d2-48c9-b07a-b00b0c...
| https://lumalabs.ai/genie?one=06d2e1bc-6290-439f-82c3-b6dab4...
|
| and not so good examples:
|
| https://lumalabs.ai/genie?one=15889f37-f001-43ca-bfbf-cd75d2...
| https://lumalabs.ai/genie?one=b7352636-2203-4ec2-9b5b-d1dd80...
|
| In the initial preview models look less lumpy and overall much
| better. So I guess the transformation from 3d
| pointcloud/gaussian splatter or whatever it uses to 3d meshes
| isn't great.
| omeze wrote:
| The models dont look bad! But based on my dives into gaming, the
| modeling work for animating anything that moves (rigging, weight
| painting, retopology, creating animations, lighting) is still
| unsolved. This is great for static assets like boxes or things
| that add flavor to an environment.
| spullara wrote:
| There are AI rigging tools in development (some prototypes have
| been released).
|
| https://actorcore.reallusion.com/auto-rig/accurig
| nunodonato wrote:
| Oh no, not another "join our discord to use it".
| andrewstuart wrote:
| Its a weird choice of UI.
|
| Why do companies do this? Is it a development shortcut or
| something?
| owenpalmer wrote:
| > Its a weird choice of UI.
|
| Yeah for sure. I guess one advantage is that since it's
| already in a chat, people can react and talk about it as it's
| happening.
| choppaface wrote:
| Both a dev shortcut as well as a stickiness play. Adding a
| Discord server is like installing a smartphone app.
| alanbernstein wrote:
| Probably. If your small team is competent at ML model
| development, why spend time building a web app?
|
| One time I participated in a small local event that required
| submitting photos via tagged Instagram posts. I was annoyed
| at that, until I realized it completely eliminated the need
| for any technical expertise for the organizers.
| bart3r wrote:
| Using discord would save you a lot on hosting costs,
| especially when dealing with huge quantities of assets like
| images and videos.
| renewiltord wrote:
| It's like Reddit but with functionality. Same benefits:
|
| - single sign-on
|
| - abuse protection
|
| - has sign-on flow for later if you want to migrate
|
| - someone else hosts assets
|
| - existing account flow means low friction to join for
| existing account holders (common in the space)
|
| - allows users to see other users at same time as use product
|
| - bot easy to spin up and async functionality is inherent
| astrange wrote:
| Image generation needs moderation and file storage, and
| Discord gives you that for free.
| thornewolf wrote:
| To be "that guy" I like this trend. It combines product usage
| w/ discussion. That said, I believe a web UI would be strictly
| better.
| datacruncher01 wrote:
| Discord? Pass.
| bart3r wrote:
| Yes, lots of people don't like using Discord, but I can't even
| get it to work. Discord just tells me 'Unable to accept invite'
| astrange wrote:
| I don't get an error, but also nothing happens when I click
| accept.
| renewiltord wrote:
| Unreasonably enjoyed the front page graphic. Played with it with
| right click and left click. This sort of thing reminds me of old
| demoscene intros to warez. Haha!
| ganarajpr wrote:
| Came here to say the exact same thing. The Homepage graphic is
| absolutely mesmerizing.
___________________________________________________________________
(page generated 2023-11-02 23:00 UTC)