Time. That is the biggest barrier to growing your own food.
Check this out as a great example of forward thinking and adaptation:
When considering the problem of grasshoppers competing with humans, John Appelt came up with an ingenious solution: The Grasshopper Harvester