Pollinators like wasps and bees can carry pollen over long distances...so if there are dragonfruit in the area, and it sounds like there are, cross pollination could easily be occurring.
The fruit set will be better with plants right next to each other, but they could still be cross pollinating.