I know what you mean. Over time I find myself coming around.
One thing I hear often is that arrow in downtown, and how that's supposed to be shorthand acknowledgment that your map is irredeemably confusing. Yet the more maps from the early 90s I play, the more I appreciate a simple arrow showing you where to start in a sandbox map. So many maps back then had arrows even in linear maps, heck there was one map of Enigma Episode that not only had an arrow in a linear (mostly) map, but you had to make an awkward jump off of it to progress.
I think it partly has to do with imagination. The longer you have, the more your brain can fill in what is already something fairly abstract.
I dunno, just some thoughts on it.