Highlighting the non-existent negative is confusing.
“Don’t be late,” isn’t as useful as, “We’re going to leave on time.”
“I don’t want to be rude, but…” can easily be replaced by simply saying something that isn’t rude.
And of course, “with all due respect…” is often the preface to something said without due respect.
