Rob
Ansys Employee

Operating density is effectively the atmospheric condition, we then set the solver pressures as gauge against that. The Outflow boundary is ancient, and if you read up on it, was never designed to work with compressible flows. 

Have a look at some of the tutorials, click on Help in Fluent to access. Also, review the CFD courses under Learning (book icon left side of the screen on this page).