"Events from email" settings won't help here, these settings control only specific types of events, all from external sources. On admin side, your best option is to set a Mail flow rule, use "The message properties" > "Include the message type" > "Calendaring" for the condition and "Block the message" as an action. Add additional conditions/exceptions as necessary, i.e. restrict it to the CEO's address, restrict it to internal messages only, add exception for the delegate, etc.
The downside of this method is that the only type of message/response you can insert is buried within the NDR message, so users might not even see it. An Outlook rule can be used to the same effect, with a custom message, but has to be configured on the client side. Unless you are OK with programmatic access to the CEO's mailbox.