If compost dries out, you're losing the bacteria and soil life that makes compost so valuable. The moisture is what keeps it all alive. There is still some good stuff there, undoubtedly, but it's not going to be the same as fresh from the composter that's still fresh and wet.