I think the high stress is an artifact of the non-congruent mesh. Look at the large overlap of the one mesh with the other.
Discard the bonded contact and use shared topology to obtain a congruent mesh so that there are no nodes that overlap into the adjacent material and I expect the stress will not be so large.