Hmmm. So then you need to be sneaky about the ham sandwhich.

Go all James Bond around the house eating it. Worse comes to worse he will just think you've gone absolutely nuts :P