He's saying that the government's power to act extends only when a person's activity harms someone else's. It does him no harm what his neighbor's religion is, so he doesn't care. This line sums up to me the reason that government should not be able to prohibit gay marriage. I am a conservative, but my outlook on gay marriage is: it doesn't harm me, so what do I care?