High potassium fertilizer, like 0-0-50, will promote more flowering. You can try bagging flower clusters with mesh bag to protect the fruits. Make sure they get consistent watering during flowering and fruiting, otherwise fruits abort. Is it possible tree is just aborting them and you are not finding underneath in ground cover?