I would not recommed a hammer on the rear sight base. It is thin metal and falrly easy to bend the base and as it is pinned into place beating it is not the answer. that is my .02 cents. If you drive out the pin and then tap it into proper square you can ise a reamer or rat tail file to remove material from the pin channel and then replace the rear sight base pin.