I've found slightly working the rear groove in the frame to be of help in this regard. If you widen & square the opening you will allow the front to nestle in better & allow you to hold it down, where it should be.
Kind of a surprise, I haven't seena factory Rem NM shoot high..they seem to leave the front sight plenty tall.
Regards,
Slim