It's not quite that simple. The phone also needs to support that capability with a DAC or Digital-Analog converter on the USB port, not all phones do.
If you need additional help or have more questions or details to share, please join the site so you can reply in this thread. See
this link for instructions on how to join Android Central.