Mail Diversion Privacy Concern

I am concrned that by using a combination of divert / leave mail on server , I can effectivly copy any mail that comes into the domain, without the intended email recipients being aware of it.

Is there any way of removing this ability ?

Cheers