Most Pastors love people. It is why they are attracted to the Pastoral Ministry.
Perhaps this is why when faced with a conflict situation the tendency can be to go into people pleasing mode. Rolling over. Particularly if that person has influence and is in a position of authority.
I have found through experience that there is a time to stand up, to push back.
Even if that person can cause you harm.
In fact the best place to be in, in ministry, is to not be concerned what people can do to you. To be able to act out of security, in Christ, rather than insecurity, in people.