The archaeology shows that hunter gatherers were setting up large communities and monumental architecture before farming, this is very clear in Anatolia - so it is not correct to assert that farming leads to settled communities, villages and towns.
Even fairly recently hunter gatherers in North America had settled communities and towns based on fishing and gathering wild rice etc, without agriculture.