Cattley lemon guava (Psidium cattleyanum) is a good option for the condition.
The yellow one is more productive than the red one in my yard.
They are pest free, quite drought tolerant (more productive and bigger fruit if gets plenty of water), easy to maintain, and very tasty fruit.
Try to find a wholesale nursery if you want to grow it along 180 ft fence.