"I have my Homey D. Clown suit and my Men on Films hats all in a little man cave," the comedian/actor, 64, tells PEOPLE in this week's issue. "My house is my house so all the stuff's in there.