No it does not stand up straight. You are correct. The U-shaped link should have a degree of freedom so it could rotate, but the other body that you mentioned stays still mainly due to the pressure of the bolt.

I even though about putting a joint in the U-shaped link, but I am not sure if is the best approach. What would you suggest?