The problem is not the difference between the inflation size and the tet element size outside.
The first problem was that the inflation layers stopped increasing in height in certain locations causing the overall thickness to be non-uniform.
I worked that out by changing the max height to base to 2 instead of 1.
Now the new issue is that just next to the tips, the length (not height) of the layers are bigger than the rest. I need something to control element size.
Please check my previous reply for the images.