“The poor despise labor when performed by slaves.”

The poor freed man despises the labor of slaves. Mason chose the security of his personal family over the Liberty and Freedom of his poor freed neighbor. Sadly, such would be the sentiment of many Planter families, with more to tend, than their personal families could labor. Yet the yoemen farmer, making up 93% of the population owned No slaves. Jefferson was elected by such faithful so-called poor yoemen farming families. Their posterity making up the Backbone of this nations Patriotism seen today rallying around President Trumps mandated call to Restore. 

In a narrow context of focus, the quote would have a different understanding than the specific statement as a stand alone generality. Its not the labor that is despised (by the rich, poor, etc.) under the whip of slavery (look at the supporting / enslaved patrons of the occupying statist theocracy's 2nd plank of the communist manifesto), it is - those who love liberty and "the animating contest of freedom" that has such extreme aversion to labor's "forced condition." Labor is: well, labor. Labor's expressions can be to participate in, inspired by, be harmonious with, etc. that which is noble, or otherwise.