I think the best thing would be to remove the weapon from the store but allow the players who bought it to keep it. In their place they will put a more balanced weapon with a lower price.