Kudos for putting thought into what will suit you best! It is so hard to choose when you have limited space. Given your space constraints, I would skip banana, they are large plants and demand space. And yes, they do ripen all at once. That is actually true for a lot of kinds of fruit - most individual trees will have ripe fruit for 2-4 weeks of each year. Some trees have better "hang time" ability than others where ripe fruit left on the tree stays good & doesn't spoil. Here's what I'm growing
Mangos - Manilita, Pickering, Maha Chanok, Fairchild
Emperor Lychee
Low chill peach - would need to consult my records to remember the variety
Gefner Atemoya
Citrus - Meyer Lemon, sugarbelle & ponkan
Emperor Lychee is nice since you can keep it dwarfed, the other varieties of lychee are not easy to size constrain. Lychees do grow slowly, so considering your patience level is important. The tradeoff is that slow growing varieties, once they reach maturity can be easier to maintain because less pruning is required to keep them small. Keeping my trees at 6' involves 1 hard pruning a year after fruit harvest, and for the mangos pinching the tips on new growth to encourage branching - usually 1 or 2 times a year. Keeping a tree small is a lot easier than trying to reduce the size of one that has grown too large.
If you can get power to all you fruit trees via extension cord, that greatly simplifies frost protection. Now that my trees are mature, frost protection is pretty easy, I string up old fashioned c9 christmas lights in November and leave them up until March. In years where we only have light frost (like the last 3), I just turn them on for nights below 35 degrees, and that's it. If a hard freeze (28 or below) is predicted, then I put up full hoop houses. I use PVC pipe to construct a frame around the tree, anchored by rebar chunks driven into the ground. Then I put a plastic cover over the frame (frame has to be big enough that the plastic doesn't touch the tree), and put a heat source (I use car trouble lights) inside the shelter, and then tie down the shelter with guy lines to keep them from blowing off. Setting up shelters for all my trees except the peach (which doesn't need it), takes the better part of a day. So it is a significant amount of work. Microclimates also matter a lot. If you can plant your frost sensitive trees next to the wall of your house (south wall is best) or under the canopy of a large tree like an oak, you can get several extra degrees of frost shelter from those little microclimates. One thing that could be fun and help you feel less antsy over the winter is to look for a sale on frost sensitive landscaping plants - oyster plants or crotons or the like. Buy a few and plant them now anyplace you think you might want to put a frost sensitive tree next spring. Give them no frost protection at all and see which are not killed off by frost over the winter. If some get killed by frost and others don't, the ones that don't show you where your microclimates are. On my property, I use oyster plants as borders in my planting beds, and it is really interesting to see which are killled by frost and which are not, the pattern on my property is consistent year to year and coorelates to which trees need most protection during cold.
If you really want a large canopied exotic, you could consider a macadamia. I'm not growing them because they can't be kept small. But my understanding is that on hard freeze years they will get knocked back a bit, but otherwise, they do fine with light frost and they are large and pretty evergreen trees.
Peach can also be larger, but I consider it the least rewarding tree and if you are space constrained I wouldn't plant one. It takes a lot of pruning, fertilizing & disease maintenance for low payoff. The fruit is incredible (which is why I keep it), but I've had only 2 good crops in 10 years. It sets fruit every year, we do get enough cold for that. Trouble is, only the years that have really cold winters (hard freezes) knock back the fruit fly population enough to allow the fruit to ripen. For last 3 years running, the entire crop has been ruined by fruit flies attacking the fruit just before they ripen. I've tried lots of ways to mitigate - none that I've found work. But I keep it because on years when my tropicals do take a hit from frost and are not going to fruit, then I will have peaches to look forward to.