You should be fine. Bees get around, and it may be self fertile.
Not sure about Haysa, but Silas Woods appears to benefit from the following tek:
When the little flowers first start to open, lightly squeeze them and roll your fingers around a little bit. Pollination!
Have been getting plenty of fruit set with only one tree.