hi, i asked a similar question about persimmons and nobody answered. After much consideration i m thinking towards position of the trees. Is there enough water and good drainage? Is there plenty of sun? Maybe even overprotection from wind can be harmful. In the case of mango, could those be unpollinated fruits? I have never grown mango up to the fruiting stage, but others may confirm or reject, whether mango needs to be pollinated to set fruit. Other types of fruit set without pollination and hence without seed, but some fruit need to be pollinated. A neighbor has a passiflora caerulaea, its flowers rarely turn to fruit and those fruits are usually empty, skin only, rarely with one or two seeds surrounded by arils, but that does not make an eatable fruit. If that is the case, put a male tree in the middle of six females.