Is our surroundings affecting our ability to concentrate the mind?

I heard about some ascetics who were incapable of concentrating their minds. After changing their environment, the Jhanas were realized easier.