Not sure it's worth a trip all by itself, but if you are heading into San Francisco for another reason the Alemany farmers market Saturdays does have good/rare local fruit. Trying to think what's available in the next month - citrus, kiwi, cherries, maybe stone fruit and guava, possibly figs.