This has been debated many many times regarding lithium-based batteries used for a hobby of mine. With no real conclusive results.
Usage patterns and conditions are so different, that it's almost impossible to compare without structured, controlled testing. And no one does that, or if they do, they don't share the results. I personally feel that yes, quick charging is probably a little tougher on the battery. But if it gets you what you need (eg- topping-off enough, quickly, to make it through a heavy-use day), then go for it. I probably wouldn't choose to use one for my overnight charger.
Especially if the battery is replaceable, I wouldn't worry about it. Replace it when it eventually doesn't do what you want.
If you want to go easy on it, you could also keep a normal charger around for the places where you normally charge. When you're driving home from work, and are still at 70%, use the normal charger. When it's noon, you're already down to 20%, and only have a half-hour of charging time available, use the quick charger.
Alternately, you could use a charge-only cable for slow (gentle) charging with a quick charger. QC 2.0 requires data communication to the charger, to enable fast charging. A charge-only cable doesn't have the data pins, so would not enable faster-charging. If you wanted to have options, while only using Quick Chargers.