Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Discussion related to the LuxCore functionality, implementations and API.
juangea
Donor
Posts: 255
Joined: Thu Jan 02, 2020 6:23 pm

Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by juangea » Tue May 04, 2021 5:04 pm

HI there.

Steffen Dunner has been doing some tests with the Texture Caching branch from Stefan Werner, and he did a test with a ton of 8k textures, I have to say that the results are incredible:
chrome_VJmgCbdm9I.png
Here is the branch in case it's useful:

https://git.blender.org/gitweb/gitweb.c ... ture_cache

This would be amazing, just with this the amount of memory taken by textures in general could be reduced A LOT and that would make 8Gb GPU's much more viable to render serious projects :)

User avatar
Odilkhan Yakubov
Posts: 151
Joined: Fri Jan 26, 2018 10:07 pm
Location: Tashkent, Uzbekistan

Re: Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by Odilkhan Yakubov » Tue May 04, 2021 5:41 pm

juangea wrote:
Tue May 04, 2021 5:04 pm
HI there.

Steffen Dunner has been doing some tests with the Texture Caching branch from Stefan Werner, and he did a test with a ton of 8k textures, I have to say that the results are incredible:

chrome_VJmgCbdm9I.png

Here is the branch in case it's useful:

https://git.blender.org/gitweb/gitweb.c ... ture_cache

This would be amazing, just with this the amount of memory taken by textures in general could be reduced A LOT and that would make 8Gb GPU's much more viable to render serious projects :)
Outstanding news if it will be a new egg! :)
Image

User avatar
Dade
Developer
Posts: 5221
Joined: Mon Dec 04, 2017 8:36 pm
Location: Italy

Re: Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by Dade » Wed May 05, 2021 10:40 am

juangea wrote:
Tue May 04, 2021 5:04 pm
This would be amazing, just with this the amount of memory taken by textures in general could be reduced A LOT and that would make 8Gb GPU's much more viable to render serious projects :)
You may misunderstand the feature: it is only for CPU rendering. It is what Arnold does (actually .tx is an Arnold format): the images use mip-maps and are broken in tiles, and you load the mi-maps/tiles on-demand, when they are required for the rendering. It allows to use very large image data sets and a very fast starting of the rendering (people uses 100+GBs of textures with Arnold).

I can add the support for it but it is cpu-only and, given most people use GPUs for rendering, doesn't sounds very useful.
Support LuxCoreRender project with salts and bounties

User avatar
Sharlybg
Donor
Posts: 2685
Joined: Mon Dec 04, 2017 10:11 pm
Location: Ivory Coast

Re: Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by Sharlybg » Wed May 05, 2021 3:09 pm

Dade wrote:
Wed May 05, 2021 10:40 am
juangea wrote:
Tue May 04, 2021 5:04 pm
This would be amazing, just with this the amount of memory taken by textures in general could be reduced A LOT and that would make 8Gb GPU's much more viable to render serious projects :)
You may misunderstand the feature: it is only for CPU rendering. It is what Arnold does (actually .tx is an Arnold format): the images use mip-maps and are broken in tiles, and you load the mi-maps/tiles on-demand, when they are required for the rendering. It allows to use very large image data sets and a very fast starting of the rendering (people uses 100+GBs of textures with Arnold).

I can add the support for it but it is cpu-only and, given most people use GPUs for rendering, doesn't sounds very useful.
I can't count the number off time when my CPU couldn't render a scene just because i ran out of Memory even with 32/64 GB.
I mean it would only make use attractive and production friendly if available.
Support LuxCoreRender project with salts and bounties

Portfolio : https://www.behance.net/DRAVIA

juangea
Donor
Posts: 255
Joined: Thu Jan 02, 2020 6:23 pm

Re: Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by juangea » Wed May 05, 2021 3:42 pm

@Dade

True, however Stefan is working in the GPU version of this, in Cycles it will support both, GPU and CPU :)

User avatar
Dade
Developer
Posts: 5221
Joined: Mon Dec 04, 2017 8:36 pm
Location: Italy

Re: Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by Dade » Wed May 05, 2021 4:38 pm

juangea wrote:
Wed May 05, 2021 3:42 pm
True, however Stefan is working in the GPU version of this, in Cycles it will support both, GPU and CPU :)
On GPUs, it will suffer of a HUGE (really HUGE) performance hit. I assume it will be no different from using out-of-core rendering with LuxCore.
Support LuxCoreRender project with salts and bounties

bestman8
Posts: 4
Joined: Sat Jul 25, 2020 6:45 pm

Re: Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by bestman8 » Wed May 05, 2021 5:00 pm

Dade wrote:
Wed May 05, 2021 10:40 am
juangea wrote:
Tue May 04, 2021 5:04 pm
This would be amazing, just with this the amount of memory taken by textures in general could be reduced A LOT and that would make 8Gb GPU's much more viable to render serious projects :)
You may misunderstand the feature: it is only for CPU rendering. It is what Arnold does (actually .tx is an Arnold format): the images use mip-maps and are broken in tiles, and you load the mi-maps/tiles on-demand, when they are required for the rendering. It allows to use very large image data sets and a very fast starting of the rendering (people uses 100+GBs of textures with Arnold).

I can add the support for it but it is cpu-only and, given most people use GPUs for rendering, doesn't sounds very useful.
i think it can be very usefull for cpu rendering but i think it shouldn't be a main priority

AndreasResch
Posts: 127
Joined: Fri Jul 06, 2018 9:32 am

Re: Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by AndreasResch » Wed May 05, 2021 5:06 pm

Every option to get around (GPU) memory problems in Luxcore already suffers huge performance hits, loss in quality and often doesn't work at all (like out of core). You might maybe want to keep an eye on this development and if it's stable, you can ditch "Tiled Path" and "Out of core" and end up having a viable alternative.

juangea
Donor
Posts: 255
Joined: Thu Jan 02, 2020 6:23 pm

Re: Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by juangea » Thu May 06, 2021 8:07 am

Well, will see what's the outcome :)

Of course if it's going to be a big performance hit it makes no sense and it should not be a priority, I agree.

However, what do you think about using MipMapping, something that is native for the GPU's and maybe can be easily handled? (I may be wrong, that's why I ask :) )

kintuX
Posts: 644
Joined: Wed Jan 10, 2018 2:37 am

Re: Texture caching... amazing improvement in memory with Cycles, could be great in LuxCore!

Post by kintuX » Thu May 06, 2021 8:28 am

Here's CPU for the win & it makes more sense considering hybrid approach.
Anyways, why I still prefer CPU engines is because I find those more stable, predictive, maneuverable, easier to handle, faster & effortless to deliver bigger projects... = more dough, better ROI
Also, after baking gets to BlendLuxCore users will have a choice and be able to "smack bitch up" in an instant.
So Yes! for texture caching.

And next, better, faster BiDir, MLT, code, new materials..." :mrgreen:

Post Reply