It is not the high-ranking official who is feared, but the person who has direct control or immediate jurisdiction over one; to be obliged to comply with those in direct authority.

虽说你是集团的高层，但所谓“不怕官，只怕管”，我现在只能听从我组长的安排。