He was in the ground then lost all leaves so I brought him to the porch hoping to keep a better eye on him. Drainage is good
The leaf drop indicated a stress factor, maybe lack of water or low temps or high winds? Digging the tree up and repotting (explains the fresh soil in the pot) will also stress the tree. I would get it out in full sun and be patient, its gonna need some recovery time. Lychees are funny trees.. They dont grow in front of your eyes like mango or other tropical fruit trees. I find it useful to take photos to record growth, its more rewarding then daily checks!
I assume the Key Lime was just potted too?