Your assessment seems right that it's not correct to specify a convection boundary conditions between the pipe and the nitrogen. If you feel the thermal mass of the nitrogen is significant you could model it as a solid body or (more likely) you could just ignore it and not have any convection on the inside pipe surface.