No.
It is ok to have ushers who are not groomsmen, in that they do not stand up with the groomsmen and bridesmaids. This is sometimes a solution when you need more ushers to direct the guests to their seats, but don't want to have twice as many groomsmen as bridesmaids.