NVIDIA DLSS in 3D rendering

General computer graphic news and papers.
User avatar
Sharlybg
Donor
Donor
Posts: 3101
Joined: Mon Dec 04, 2017 10:11 pm
Location: Ivory Coast

NVIDIA DLSS in 3D rendering

Post by Sharlybg »

while viewing all the tech news falling all arround recently on the internet i was thinking about the idea of taking those new advancement to support our renderer.
Especially the DLSS from NVIDIA that can make a higher resolution from a very low resolution input and this in realtime.This could be an extremelly speed up for both still and animation rendering.

Going from 1/2 k to 2k would mean 8X speed up. i do the math for you a 1hour frame will cost you just 7mn and a 10mn frame just 1mn 30 scs
there is already AI gigapixel but isn't free and not integrated.

sadly this is what the nvidia website say :
Q: How do I integrate DLSS into my engine?

A: For information on integrating DLSS into a new engine, contact your NVIDIA developer relations contact.
explaination here :
https://youtu.be/BeScfkCm3b4
Support LuxCoreRender project with salts and bounties

Portfolio : https://www.behance.net/DRAVIA
User avatar
lacilaci
Donor
Donor
Posts: 1969
Joined: Fri May 04, 2018 5:16 am

Re: NVIDIA DLSS in 3D rendering

Post by lacilaci »

I'm not so sure if it would be great for stills. But for animations it could be.
Octane does some "ai" upscaling, but currently i haven't found it to be very useful.
Maybe if nvidia released some fast ai upscaler separately similar to optix denoiser...
User avatar
Dade
Developer
Developer
Posts: 5672
Joined: Mon Dec 04, 2017 8:36 pm
Location: Italy

Re: NVIDIA DLSS in 3D rendering

Post by Dade »

lacilaci wrote: Fri May 15, 2020 3:47 pm Maybe if nvidia released some fast ai upscaler separately similar to optix denoiser...
Indeed, it isn't a viable option until when NVIDIA don't release public SDK.
Support LuxCoreRender project with salts and bounties
User avatar
Sharlybg
Donor
Donor
Posts: 3101
Joined: Mon Dec 04, 2017 10:11 pm
Location: Ivory Coast

Re: NVIDIA DLSS in 3D rendering

Post by Sharlybg »

D5 render is using DLSS for rendering now :

https://youtu.be/__qZxXZMlWc
Support LuxCoreRender project with salts and bounties

Portfolio : https://www.behance.net/DRAVIA
User avatar
lacilaci
Donor
Donor
Posts: 1969
Joined: Fri May 04, 2018 5:16 am

Re: NVIDIA DLSS in 3D rendering

Post by lacilaci »

There is also some new dlss version that practically doubles performance in unreal engine while keeping the image quality untouched!

While dlss works with raytracing isn't it also relying on directx? I'm not sure if it would work with pure pathtracer. It is incredible though.
User avatar
Dade
Developer
Developer
Posts: 5672
Joined: Mon Dec 04, 2017 8:36 pm
Location: Italy

Re: NVIDIA DLSS in 3D rendering

Post by Dade »

It is mostly intended for anti-aliasing rasterization renderings so I doubt it can be of any use in its current state. However it is a topic related to upscaling images so, something related, could be used to upscale path traced images.

Anyway, I don't see any public SDK or any reference to DLSS in Optix or CUDA so I doubt that is even accessible for us.
Support LuxCoreRender project with salts and bounties
User avatar
lacilaci
Donor
Donor
Posts: 1969
Joined: Fri May 04, 2018 5:16 am

Re: NVIDIA DLSS in 3D rendering

Post by lacilaci »

Dade wrote: Tue Sep 22, 2020 7:48 pm It is mostly intended for anti-aliasing rasterization renderings so I doubt it can be of any use in its current state. However it is a topic related to upscaling images so, something related, could be used to upscale path traced images.

Anyway, I don't see any public SDK or any reference to DLSS in Optix or CUDA so I doubt that is even accessible for us.
It's available if you are registered on their site and submit a form with a request. But they currently only approve it for certain projects (probably only bigger AAA games and projects like D5 renderer). So not publicly available yet and also I'm 99% sure it currently only works with stuff running on DX12 so rasterization and DXR raytracing. Maybe if they make an optix version or something.

That said, results are quite impressive. Every upscaler I tried(service like letsenhance or standalone gigapixel app) is nowhere close with fidelity and speed since they obviously have to work with final image.

This and RTXGI(less impressive, sparse probe tracing for realtime GI) are they newest tools both aimed at games and realtime renderers like Unreal and twinmotion or D5renderer. They even have some caustic tracing WIP that can even do sds realtime they demonstrated these all in their branch of unreal engine.
User avatar
Sharlybg
Donor
Donor
Posts: 3101
Joined: Mon Dec 04, 2017 10:11 pm
Location: Ivory Coast

Re: NVIDIA DLSS in 3D rendering

Post by Sharlybg »

This and RTXGI(less impressive, sparse probe tracing for realtime GI) are they newest tools both aimed at games and realtime renderers like Unreal and twinmotion or D5renderer. They even have some caustic tracing WIP that can even do sds realtime they demonstrated these all in their branch of unreal engine.
This one can really compensate the lack of support of Eevee and material preview mode.
Support LuxCoreRender project with salts and bounties

Portfolio : https://www.behance.net/DRAVIA
User avatar
Dade
Developer
Developer
Posts: 5672
Joined: Mon Dec 04, 2017 8:36 pm
Location: Italy

Re: NVIDIA DLSS in 3D rendering

Post by Dade »

lacilaci wrote: Wed Sep 23, 2020 7:07 am This and RTXGI(less impressive, sparse probe tracing for realtime GI)
I looked into this one when it was released but, again, it is DirectX-only.
Support LuxCoreRender project with salts and bounties
User avatar
Sharlybg
Donor
Donor
Posts: 3101
Joined: Mon Dec 04, 2017 10:11 pm
Location: Ivory Coast

Re: NVIDIA AI NVIDIA Maxine

Post by Sharlybg »

Ai based super resolution GPU accelerated :

Video : https://youtu.be/eFK7Iy8enqM

https://developer.nvidia.com/maxine

This shouldn't be only for rasterized game like DLSS.
Support LuxCoreRender project with salts and bounties

Portfolio : https://www.behance.net/DRAVIA
Post Reply