The theory has assumption that the structure is symmetric. Is your structure symmetric for s and p polarization? say it is circular shape?
Please refer to this example: https://optics.ansys.com/hc/en-us/articles/360042097393-Metamaterial-parameter-extraction-Smith