Prevent system manager from seeing everybody's emails

Is there a way to configure the communication doctype permissions to prevent ‘system manager’ role from viewing everybody’s emails. I have tried playing around with the permissions but it seems to be an all or nothing affair i.e. the system manager either sees everybody’s emails or sees nothing at all, including his own emails.