[HN Gopher] Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fi... ___________________________________________________________________ Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields Author : netuffresche Score : 51 points Date : 2023-06-06 06:32 UTC (16 hours ago) (HTM) web link (jonbarron.info) (TXT) w3m dump (jonbarron.info) | Y_Y wrote: | Where's the damn code? | esafak wrote: | https://paperswithcode.com/paper/zip-nerf-anti-aliased-grid-... | lairv wrote: | Another recent cool work in this field is this paper : | https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/ | | They manage to get the same quality, with <1hr of training, and | running at 60fps 1080p, it uses point cloud instead of volumetric | representation | IshKebab wrote: | Very impressive! How far are we from having this sort of thing in | VR? The paper says the model render time was 0.9s which I guess | means very far if that is per frame? | krasin wrote: | instant-ngp ([1]) from NVIDIA can render NeRF in VR in real- | time, assuming a very good desktop video card. Note that | instant-ngp is not as photo-realistic as Zip-NeRF. But it's | still very good! | | 1. https://github.com/NVlabs/instant-ngp | xrd wrote: | I've been fascinated by NeRFs for a few years. | | But, there are really no viable models that run on consumer | hardware like llama or stable diffusion. | | Or, am I wrong? NeRF Studio seems promising but never works on my | 6GB nvidia. | | I would really like to find a way to interpolate between two | images using a NeRF (get the hallucination of the "image in | between"). | | Is there such a thing out there? | dheera wrote: | I don't know about 6GB but if you have a 12GB or 16GB card you | should be able to run the vast majority of NeRF work out there, | most of it is designed to run on a single GPU. | riotnrrd wrote: | I mostly have experience with Instant NGP, and it should work | on older consumer NVIDIA cards. Their github page calls out | Pascal cards as working, for example. 6 GB isn't much memory, | though, so you may be limited in final resolution of the latent | model and thus of the output. | djsavvy wrote: | I'm not sure I understand what this does --- what are the inputs | and outputs? | krasin wrote: | The inputs are just photos from different positions. Then a | neural net is trained so that you can ask to render a photo | from any pose (including unseen). | | This particular work (Zip-NeRF) builds on top of the original | NeRF paper: https://www.matthewtancik.com/nerf (the website has | a good explanation what NeRF aka Neural Radiance Fields are) | yarg wrote: | This is amazing, but... | | It feels too damned clean, and I'm not sure its just the weirdly | alien camera stability. ___________________________________________________________________ (page generated 2023-06-06 23:00 UTC)