Page 1 of 3

NVIDIA DLSS in 3D rendering

Posted: Fri May 15, 2020 3:06 pm
by Sharlybg
while viewing all the tech news falling all arround recently on the internet i was thinking about the idea of taking those new advancement to support our renderer.
Especially the DLSS from NVIDIA that can make a higher resolution from a very low resolution input and this in realtime.This could be an extremelly speed up for both still and animation rendering.

Going from 1/2 k to 2k would mean 8X speed up. i do the math for you a 1hour frame will cost you just 7mn and a 10mn frame just 1mn 30 scs
there is already AI gigapixel but isn't free and not integrated.

sadly this is what the nvidia website say :
Q: How do I integrate DLSS into my engine?

A: For information on integrating DLSS into a new engine, contact your NVIDIA developer relations contact.
explaination here :
https://youtu.be/BeScfkCm3b4

Re: NVIDIA DLSS in 3D rendering

Posted: Fri May 15, 2020 3:47 pm
by lacilaci
I'm not so sure if it would be great for stills. But for animations it could be.
Octane does some "ai" upscaling, but currently i haven't found it to be very useful.
Maybe if nvidia released some fast ai upscaler separately similar to optix denoiser...

Re: NVIDIA DLSS in 3D rendering

Posted: Fri May 15, 2020 4:13 pm
by Dade
lacilaci wrote: Fri May 15, 2020 3:47 pm Maybe if nvidia released some fast ai upscaler separately similar to optix denoiser...
Indeed, it isn't a viable option until when NVIDIA don't release public SDK.

Re: NVIDIA DLSS in 3D rendering

Posted: Tue Sep 22, 2020 10:08 am
by Sharlybg
D5 render is using DLSS for rendering now :

https://youtu.be/__qZxXZMlWc

Re: NVIDIA DLSS in 3D rendering

Posted: Tue Sep 22, 2020 6:03 pm
by lacilaci
There is also some new dlss version that practically doubles performance in unreal engine while keeping the image quality untouched!

While dlss works with raytracing isn't it also relying on directx? I'm not sure if it would work with pure pathtracer. It is incredible though.

Re: NVIDIA DLSS in 3D rendering

Posted: Tue Sep 22, 2020 7:48 pm
by Dade
It is mostly intended for anti-aliasing rasterization renderings so I doubt it can be of any use in its current state. However it is a topic related to upscaling images so, something related, could be used to upscale path traced images.

Anyway, I don't see any public SDK or any reference to DLSS in Optix or CUDA so I doubt that is even accessible for us.

Re: NVIDIA DLSS in 3D rendering

Posted: Wed Sep 23, 2020 7:07 am
by lacilaci
Dade wrote: Tue Sep 22, 2020 7:48 pm It is mostly intended for anti-aliasing rasterization renderings so I doubt it can be of any use in its current state. However it is a topic related to upscaling images so, something related, could be used to upscale path traced images.

Anyway, I don't see any public SDK or any reference to DLSS in Optix or CUDA so I doubt that is even accessible for us.
It's available if you are registered on their site and submit a form with a request. But they currently only approve it for certain projects (probably only bigger AAA games and projects like D5 renderer). So not publicly available yet and also I'm 99% sure it currently only works with stuff running on DX12 so rasterization and DXR raytracing. Maybe if they make an optix version or something.

That said, results are quite impressive. Every upscaler I tried(service like letsenhance or standalone gigapixel app) is nowhere close with fidelity and speed since they obviously have to work with final image.

This and RTXGI(less impressive, sparse probe tracing for realtime GI) are they newest tools both aimed at games and realtime renderers like Unreal and twinmotion or D5renderer. They even have some caustic tracing WIP that can even do sds realtime they demonstrated these all in their branch of unreal engine.

Re: NVIDIA DLSS in 3D rendering

Posted: Wed Sep 23, 2020 8:24 am
by Sharlybg
This and RTXGI(less impressive, sparse probe tracing for realtime GI) are they newest tools both aimed at games and realtime renderers like Unreal and twinmotion or D5renderer. They even have some caustic tracing WIP that can even do sds realtime they demonstrated these all in their branch of unreal engine.
This one can really compensate the lack of support of Eevee and material preview mode.

Re: NVIDIA DLSS in 3D rendering

Posted: Wed Sep 23, 2020 11:01 am
by Dade
lacilaci wrote: Wed Sep 23, 2020 7:07 am This and RTXGI(less impressive, sparse probe tracing for realtime GI)
I looked into this one when it was released but, again, it is DirectX-only.

Re: NVIDIA AI NVIDIA Maxine

Posted: Wed Oct 07, 2020 4:25 pm
by Sharlybg
Ai based super resolution GPU accelerated :

Video : https://youtu.be/eFK7Iy8enqM

https://developer.nvidia.com/maxine

This shouldn't be only for rasterized game like DLSS.