Does it matter if you leave near or far away from your investment properties?

I live in northern NJ and am looking to buy properties around the country. If I hire a property manager to take care of the problems, does it matter where the properties are in relation to where I am? I keep hearing people say ';you should live near your investment';. Why would it matter if I am hiring a property manager?