This is just from memory, but from research I've looked into in the past it is possible.
Vanilla orchid can grow in Southern California but it requires a spot under a patio, or other ideal spot, where it will get mostly shade, and needs to be planted in a spot that has some humidity, like from lots of other surrounding plants that get watered often.
You're going to have to create the right microclimate where it won't get baked in the sun and dry out.
It's also going to need to be surrounded, to avoid winds blowing through and drying things out. But the spot can't be completely shaded or cold all the time, and at least a little bit of sunlight has to be able to filter down onto the plant.
For anyone who's ever tried to grow gardenias or raspberries in Southern California, you know what I mean.