"Resident's Committee" is my best shot at translating a common feature of Japanese localities, the Jichikai. It's supposed to include all residents in an area, but tends not to include recent arrivals (due to inertia rather than prejudice in most cases).

Bear in mind, as well, that you're only hearing about the people who come to the shrine over their problems. You aren't getting a random sample.