I'm okay with that. We should get closer to paying for the real value of a chicken, or pig, or strawberries, than what we're currently paying. If that means improved labor conditions, less pollution, and not supporting industry that creates a welfare state then I consider those all wins. Who knows, maybe it would even reduce the amount of food waste and make us more efficient with our food.
By buying from the Walmarts of the world or the large scale factories of the world, we support an environment that is less than admirable, and exploitative of the workforce. This is where Trump fails, and where wall supporters fail, I think. I'd wager that the majority of these workers are immigrants, legally or illegally. The fallacy of "they'll take our jobs" is ridiculous because nobody wants to work in these conditions.