Some ants will do similar damage, look for those in the daytime, too.
Definitely bugs, your tree looks healthy. It's planted too close to your patio, will probably cause some issues years down the road, but that's not an easy fix with how big it already is.