And, in the spirit of my favourite game of 'if you put that celebrity and that celebrity together, they would make this celebrity', my mental image for Mr Holmes has always been Jeremy Northam (if he had hazelly eyes). I think it's the nose. And the slightly sarcastic eyes.
There you go, people, answers to questions you didn't have. You're welcome.