Saijo will probably be just fine, but I would hesitate to plant more than a few trees for personal consumption unless preserving them. Some people love them so much though that multiple trees makes sense, but for most, they are so sweet, after a few fruits, the rest end up getting preserved.
That said, for flavor, the pollination variant types like chocolate, coffecake, maru and ilk have excellent flavor profiles when pollinated, which is a good reason to have chocolate, as it produces large bunches of smaller, male flowers, which pollinate the female flowers causing seeds, brown flesh, and improved flavor.
I had a branch of hyakume, which had superior texture, especially when seared with a torch, but it broke off when I failed to thin it one year.