I feel it's pretty safe. I use uber daily as a rider and I've had male/female drivers of varying ages.

The only thing I would do is maybe get another phone line just for uber. You don't want your personal number out there.