ruffle some feathers informal
To deliberately aggravate somebody, especially somebody in a position of power or authority.