Let it be. The panicle may drop off by itself or set a couple of fruits. Knock them off when they are marble size and knock the panicle off after it dries up. It will likely branch from that point.
If you want your tree taller before it branches. Keep the most vigorous of the branches and stake it up.