Jeff,
I am most impressed that you were able to get lychee to fruit for you and in Brooklyn!!! Is that a 3 or 7 gal plant. what type of soil did you use and how do you over winter them? Sorry I am not able to tell U what you did wrong but you must have done something right