To refrain from taking action against an evil person or problem because of the risk of harming innocent people or valuable things nearby; literally to hesitate at throwing something at a rat for fear of breaking the vase it is next to.