I say yes, I even try not to drive into my area (or anyones).
It's been found that 90% of the deer taken during any given season are taken during the first two weeks. That just goes to show that once the hunting pressure starts, it doesn't
take the deer very long to figure out we're after them. While deer don't have a long term memory, hunting pressure does cause them to alter their travel and feeding patterns which has a definite impact on our chances of seeing them during daylight hours.
IMO, if you want the best chance to catch a wary buck on his way back to or from his bedroom, stay out of his neighborhood until you're ready to sneak up on his house.
I should add that taking long walks to your stand during middle of the week hunts later in the season can be extremely effective. After those first weeks of the season, the deer just seem to know when the weekends arrive. The extra noise on weekends probably has something to do with that. I took a very nice ten-point late last season following that approach.