The small city (~20k people) that I grew up in has no less than five local banks in addition to offices of the major banks. Competition is indeed pretty healthy.

(Local, meaning under 10 branches total, confined to NJ -- some of them having their only branch in town.)