Thanks for the scene.
I've tested it and the first problem I am seeing is that although the adaptive has more samples in some regions, those are still noisier than the the non-adaptive version. I am probably doing something stupid for that to be the case.
Besides, the tonemapping interferes with the noise estimation. I will try to fix that after I find the other issue