Thank you.
I assume, from your description of grey, rocky soil, that you have limestone or shell rock, covered with some black sandy loam or with muck, that was placed there for sodding.
You could get a 50-pound bag of prilled Sulfur, such as Tiger-90 or similar, probably for around $30, and spread it all within a circle twice the radius of the tree's canopy, to within about a foot of the trunk. This will lower the pH of the soil's surface, and reactivate some of the fertilizer that you put down previously. Do this, with some fruit tree fertilizer, three times a year, until the tree greens up, in a couple of years.