“As soon as any man says of the affairs of the State 'What does it matter to me?' the State may be given up for lost.”