I don’t think that your assumptions are true. Non-voters tend to be more progressive than voters, because conservatives vote religiously out of a sense of duty and responsibility, and progressives vote when they feel like it.

This is a lever that moves in two directions. Voter suppression is a very real thing that happens in every American election. It’s practiced by conservative candidates for exactly the asymmetry I mention above.