Here's my two cents...
I grew up in the northeast U.S where the most exotic fruit was cherries and oranges.
I moved to So. Flo in 1976 and by the early 80's "discovered" mango, banana, and sugar apple.
Not knowing when to pick them, the sugar apple had ripened fruits that became infested with ants. The banana died for not having enough water (remember there was no internet for advice back then) and while the mango (an odd small one called "peach mango) grew to huge proportions and while I liked the mango my ex became a PITA about dropped fruit and vermin (2 and 4 legged) taking it.
Fast forward to 2009 (post divorce) I planted my yard with many fruits and am now enjoying them. Thanks to Gardenweb.com and most of the members who moved here, I had sufficient information to have some moderate success.
So I'll say I "get" why peeps don't grow tropical fruit and I'll say ignorance of varied selections are the main reason. And BTW, many who have never tried the more rare tropicals have little exposure to them in a retail environment and the few they sampled like Brian above...
"Java plums are awful. Jujubes are inferior to apples. Breadfruit is gross. Soursop is meh. Star apple is mediocre. Sapodilla is too sweet.
I love sapotes but my wife didn't like them, same with surinam cherries. I love jackfruit but my brother says it smells awful. I tried a ton of different types of bananas in India and still like Cavendish the best"
I see why some don't "get" it :-0
I doubt a tree / plant ripened starfruit, Jabo, pineapple, lychee, canistel, sugar apple, guava, persimmon and more picked from a private collection would get a meh response from many.