Just did this during the summer. We bought the first house before we were married or had kids and outgrew it now that we are and have 2.
While it was only a 1/4th acre lot i had 5 producing mangos, sugar apples, dragon and passion fruit trellises, bananas, and assorted other items on the lot. The extent the small lot was planted out was likely to be a draw back but based on the size and location of the house likely ended up being a selling point as most of the demographic was hispanic or asian and they appreciate (or know what) tropicals are than your typical american.
It was tough leaving things behind. I did get a slightly larger yard but made the choice to plant quality - items i really know i enjoy 100% - rather than quantity to keep the aesthetic of the house and planted mango, avocado, star fruit and sapodilla varieties i know i loved. While i left behind fruiting trees, i off-set this by setting a budget from the proceeds of the house sale to plant 15-25g trees that are of producing size.
If, as you say, most trees are not producing size you could likely dig them up and repot them prior to showing the house and re-sod the dirt patches left, could you not? The only real thing you'd need to consider is storage space so the yard doesnt look too cluttered.