Thank you for valauble reply. Yes, I am using PML bundaries as of now. I want only the propagating modes with the desired HE/EH  pattern. But if I use metal BCs I do see non-propagating modes as you mentioned then why to look at them, how to search for only propagating modes of higher order HE. ?