Removing leaves doesn't control CLM; unless the larvae/pupa are still within the leaves, you should leave them on the tree. Even if the leaves look completely mangled, the tree can get something from them and will abandon them on its own. Flipping a newly damaged leaf over, you should be able to see if the bug is still there. If you don't have young eyes, use a magnifying glass to make spotting them easier; they are tiny. Just pinch the flat leaf whenever you find one, you'll feel a tiny squish from the bug when you crush it.
I battled CLM all last year. The spot in my yard where I have the potted citrus is crazy with them. I gave up on timing fertilizers and using neem oil, spinosad sprays in the evening every 3-4 weeks has kept them under control so far this season. Also, I've given trees to my next door neighbor (maybe 50 yards from my trees) and a friend around a mile away; their trees don't get bothered by CLM at all. If you can move your tree(s), even a little, it might help.