One of the characteristics of the golem is that it assumes the characteristics of the one who gave it life. So it stands to reason that if you’re a vapid narcissist your golem is unlikely to be receptive to external stimuli.