What soil is in that pot? It looks a bit too heavy for a plant in a pot. A bigger pot and some lighter potting mix would possibly do wonders. It should be growing like crazy in summer! If you are able to plant in ground, I would do that. I’ve got 3 year old Jakfruit in the ground over 12ft tall. Way better in the ground if you can.