Good job. I think I have the same small round fruits variety as you. I hand pollinate it as well. So far, less fruits than you. On hot sunny day, the pollen is ready around 3pm. At 8 pm, it the pollen is less potent, from my observation.
I also has another bigger, and longer fruits variety. The flowers have about 4 times more. The pollen is ready around 1pm. I use these flowers to pollenate the round fruit variety.
The flowers that drops,imo, has to do with how potent the pollen is; that is, how fresh the pollens are. So when to pollenate is cruicial.
If your tree is over produced, the flowers will not drop. Usually, the fruits will be smaller or drop later on.