If it grows over the fence anybody is welcomed to pick it, unless breaking branches or thinking that I'm stupid. There is a lot of english and french backpackers traveling and I couldn't care less. I'm happy to share my fruits with neighbors also. If it grows towards the inner side, is for my family.
I had a lot of elders making noise with umbrellas and even a "very white" man descending from a expensive car, dressed as golfer (shorts, cap and all the stuff) pretending to exercise its swing in the street, with the very obvious purpose to hit my walnut with the golf stick when nobody is looking. The little man smiling defiant to me was so ridiculous and annoying that I stand in place until he got tired of waiting, and I removed all fruits hanging over the street in the very next day.