The problem is the HOA exists where it does so if I want to buy there for the other benefits of the location (e.g. school) I have to submit to the HOA. The idea of HOAs originally came about as one method of stopping blacks and other minorities from buying in those areas. Simultaneously these areas got things like pools and gathering areas (clubhouses) while they closed the public versions of these places.