Neem oil them like crazy at least a couple of times before bringing them inside. That is just a general rule I have for all citrus, because indoor citrus attract spider mites like the two are magnetized. Finger limes' small leaves make even a mild infestation of spider mites especially damaging.
Also, be careful with your soil moisture level for indoor citrus. You want to avoid root rot, and you can get it pretty quickly with any citrus. Add together a plastic pot, too much water, and cooler temperatures, and your citrus can take a turn for the worse, particularly if they are small and have not filled out their containers. Neither finger limes nor blood oranges grow particularly prolific root systems, in my experience with them as container plants; their root systems are somewhat weak in comparison to limes, lemons, etc., making them a bit more susceptible to root rot. Of course, if yours are grafted, you have to worry more about whatever root stock they are on.