There may be a couple of hundred species to avoid for California but most would be ok. When you look at species like E. sideroxylon, phoenicea, megacarpa, miniata, regnans, torelliana and swamp bloodwood there is not much danger of them becoming pests and they have lots going for them.