I'm not sure. I also have more experience with this question in avocado's. In avocado's and most other plants I know of, there is no correlation. The size of the seed can be dependent on the growing conditions for that year for that particular branch or flower (- the more leaves there are per fruit on any branch, the more water the plant gets, etc, will result in more reserves stored in the seed).
I always wondered wether the size of the seed could actually depend on the pollen the seed is pollinated with (depending on the compatibility of the pollen with the embryo). Otherwise the genetic information for vigour, size and other plant characteristics of the embryo, including the size of the seeds it will produce, normally develop completely independently of the seed size the embryo came with from her mother plant. Seed size can be seen as a savings account that the mother makes, depending on local conditions, and gives to her offspring when she sets them off into the big wide world.