I have been wearing smart glasses for several years now when out and about. Not ray-bans but echo frames. Yea, the only real issue is with battery life, a little over three hours, the third gen will be released soon with the promise of six hours of battery usage. I think they are worth it. As far as looking suspicious, nope, more like a nerd.
I wear them at work where earbuds are not allowed because smart glasses are not that common yet so management don't know what they are. The biggest bonus is, nothing is jammed down the ear canal. In the end, I do believe the benefits outweigh the cons.