Several things lead to brown or black spots besides mites. Could be mites though. I have seen cold weather do that on fruit that is young like that when it gets cold.
Scroll down to the picture of the frost damaged fruit. But depending on the variety and how mature the fruit is, smaller younger fruit being more susceptible it might not need to freeze and might not damage the leaves. This usually happens when you have really small undeveloped fruit hit by cold temps. There's also fungus that leaves similar marks. Almost all Florida citrus is marked up unless they are spraying it with something but those look particularly bad.
https://edis.ifas.ufl.edu/publication/HS1275