Many plants are very adaptable and can grow in a range of micro climates, but then there are also those plants that are not very adaptabe and those are the ones that will succumb to even very minor changes. It's good to have genetic diversity, and gene banks can eventually supply hardier cultivars. As is usual, the people that will suffer the most are the impoverished, the ones that spend most of their income on food. Climate changes, scarcity of water, and higher fuel costs will make food prices go up. When most of your income is spent on food even a minor increase can be quite catastrophic. A lot of poor people also live at close to sea level. Any minor increase in ocean levels would also be very catastrophic for these people, for example Indonesia, many other parts of Asia, and small islands, especially coral atolls.