I had a similar issue on a Windham weaponry I worked on for someone, it appeared the pins where to big, by the time I received it it had already seen a dermel (and for some reason an angle grinder some people just don’t know when to quit ) anyway you really just gotta hit those pins the surface you have it on matters as must as the punch or hammer you use.