“We want the will of the people, not the votes of the people; and to give a man a vote against his will is to make voting more valuable than the democracy it declares.”