Actually, the Know Nothings were the reason Lincoln became president. They were part of the coalition that elected him. This quote was not spoken publicly nor widely known, otherwise he wouldn't have become president!