GSMArena Updated Its Audio Quality Tests

[jensigner]

Agreed that headphone damping isn't such a big deal compared to speaker damping. For interest, I measured the output impedance at 440 Hz of the S3 using 10 ohm resistive loads on both channels and a scope. I did this at 2 volume slider levels on Music Player (10/15 and 12/15). With this 10ohm load, clipping distortion shows at 14/15. The S3 output impedance is calculated simply from the voltage divider compared with the output voltage with open load.
The result is Zout(400Hz) = 2.7 +/- 0.2 ohm and the same at both volume levels tested.
Also I did a spot check of the output spectrum using RMAA spectrum analyzer (with 22 ohm resistive loads and at a volume of 12/15 ..pretty loud) and it looks pretty clean. The source file was a 16bit/44.1kHz pure sine wave wav file at 440 Hz at almost full digital level (-0.2dB) :
S3 Spectrum for 440 Hz Tone

 

[LoganK]

Agreed that headphone damping isn't such a big deal compared to speaker damping. For interest, I measured the output impedance at 440 Hz of the S3 using 10 ohm resistive loads on both channels and a scope. I did this at 2 volume slider levels on Music Player (10/15 and 12/15). With this 10ohm load, clipping distortion shows at 14/15. The S3 output impedance is calculated simply from the voltage divider compared with the output voltage with open load.
The result is Zout(400Hz) = 2.7 +/- 0.2 ohm and the same at both volume levels tested.
Also I did a spot check of the output spectrum using RMAA spectrum analyzer (with 22 ohm resistive loads and at a volume of 12/15 ..pretty loud) and it looks pretty clean. The source file was a 16bit/44.1kHz pure sine wave wav file at 440 Hz at almost full digital level (-0.2dB) :
S3 Spectrum for 440 Hz Tone

Very interesting. I don't expect that I'd be able to hear -120 dB noise, so perhaps it is a manufacturing problem. (I bought the instant T-Mobile would sell me a model without a contract, so they were certainly rushing them off the line.)

For reference, without the tweaked headphone amp, I tend to listen with my ear buds at a volume level of 1/15. (I might even go a touch lower if it allowed me.) If I have to crank it to 10 to get to a proper volume level, then most of the noise is likely to be lost in whatever is eating the power.

At the gym with different headphones I tend to be around 13 or 14, but there the environmental noise drowns out anything the phone might be doing.

 

[jensigner]

For reference, without the tweaked headphone amp, I tend to listen with my ear buds at a volume level of 1/15. (I might even go a touch lower if it allowed me.) If I have to crank it to 10 to get to a proper volume level, then most of the noise is likely to be lost in whatever is eating the power.
.

Just did some more listening tests with S3 earbuds, Creative Earbuds and the Senn HD598: phones both earbudss are almost inaudible at 1/15 volume. Comfortable volume is ~ 5/15. Comfortable volume with the Senns is 10/15. The supplied S3 earbuds sound horrible but the Creative ones are very good!

 

[LoganK]

Just did some more listening tests with S3 earbuds, Creative Earbuds and the Senn HD598: phones both earbudss are almost inaudible at 1/15 volume. Comfortable volume is ~ 5/15. Comfortable volume with the Senns is 10/15. The supplied S3 earbuds sound horrible but the Creative ones are very good!

That's interesting. I wonder if it's a difference with the T-Mobile version or the hardware.

I have a large number of of JVCs (the JVC FX40 earbuds are still my favorite of everything I've tried), the Samsung earbuds, a couple of Sennheisers, a set of Sony, a set of Munitio (don't laugh too much), and the Jays A-Jay. For all of them (although less so for the Jays), volume level 5 is where I would start describing it as uncomfortably loud.

It really doesn't change my plan. I'll find an S4 in the store, listen to it with my own earbuds, and buy a new phone if it doesn't sound terrible out of the box. After Google I/O, of course. I'm somewhat nervous that Google might do something crazy like add an SD card to the Nexus 4 or release a new feature that I now can't live without. (It'll also give Samsung a chance to settle any manufacturing issues that crop up and T-Mobile will likely have dropped the price by $50.)

 

[LoganK]

I finally got a chance to use a HTC One today. While it was unfortunately in kind of a loud environment, my impressions were:

• The speakers are awesome. They seemed loud, clear, and better than most tablets I've used.
• Ear buds with Beats enabled sounded awful. Lots of noise, some distortion ... it was distracting.
• Ear buds without the Beats feature sounded clean and sharp. Much, much better than what I hear with my S III.

As I mentioned, it was fairly loud, and my observations are far from scientific, but I could definitely see using the HTC One for music. I would have to leave Beats off for my own sanity, but I wonder if that mode may actually be helpful when using poor-quality headphones (perceived volume boost, maybe?).

 

[jensigner]

I finally got a chance to use a HTC One today. While it was unfortunately in kind of a loud environment, my impressions were:

• The speakers are awesome. They seemed loud, clear, and better than most tablets I've used.
• Ear buds with Beats enabled sounded awful. Lots of noise, some distortion ... it was distracting.
• Ear buds without the Beats feature sounded clean and sharp. Much, much better than what I hear with my S III.

As I mentioned, it was fairly loud, and my observations are far from scientific, but I could definitely see using the HTC One for music. I would have to leave Beats off for my own sanity, but I wonder if that mode may actually be helpful when using poor-quality headphones (perceived volume boost, maybe?).

Very interesting! Were you using the stock earbuds provided? Would be interesting to know what "Beats Audio" does to the earphone-out sound sonically. I'm still considering The One.

 

[snookasnoo]

The iPhone 5 has better call quality. Pretty much every review has said the S 4 quality is average at best.

Does anyone know if audio is typically better overall on iphone vs galaxy. Right now im an iphone 4 awaiting delivery of my S4, ive read a few articles about the sound quality which is one of the reasons ive decided to make the switch and ive also read about this Wolfson chip, will it be in the UK S4 snapdragon version?

 

[LoganK]

Very interesting! Were you using the stock earbuds provided? Would be interesting to know what "Beats Audio" does to the earphone-out sound sonically. I'm still considering The One.

No, I brought in my own ear buds that I would use if I owned the phone. I'm sure the stock ones are okay, but I'm not familiar with them and having a whole store share ear buds is weird.

I'd love to know the Beats "secret sauce", too. I'm sure it works in certain situations, but it sure didn't impress me in my short time with it.

 

[jensigner]

I'd love to know the Beats "secret sauce", too. I'm sure it works in certain situations, but it sure didn't impress me in my short time with it.

In the chart posted above by Suda, I assume the results for the HTC One with and without headphones connected are with Beats Audio turned off? I think the "secret sauce" is just some equalization thing and and RMAA test with/without BA turned on would be telling. If I decide to go with the HTC One, that will be one of the first tests I do

 

[qitupx]

Hmm, I think I must have a defective phone. Once I hit about 75% volume there is major distortion in the lower frequencies.

 

[LoganK]

Hmm, I think I must have a defective phone. Once I hit about 75% volume there is major distortion in the lower frequencies.

Your problem is only when you have the equalizer enabled, correct? Is this headphones or the speaker?

 

[qitupx]

Ok, so this is interesting. My headphones sounded like crap on the S4, not just mine, but I tested out two other display units at the sprint store, sounds the same on all of them. My headphones sound perfectly fine on all the other devices i tested (HTC One, Galaxy Note 2, Galaxy S3, and I was sure to enable the equalizer on all of them for a fair test.) I also tested like 6 other pairs of headphones that sound fine on the s4. Seems like it was just some weird combination of my headphones with that phone and my headphones. Very weird. I usually use Noozxoide but it sounds weird as well. I used the built in EQ since i was testing floor models though. I think it might have something to do with the impedance of the buds I had. They are 13 Ohm. Here are the specs and maybe someone else has issues with similar characteristics:

Ultimate Ears Super.Fi 5 Specs
Driver: single custom balanced armature, top-firing
Sensitivity: 115dB @ 1mW
Impedance: 13 Ohm @ 1kHz
Frequency range: 15Hz ? 15kHz
Cable: 120cm/46? (Y-style), straight 3.5mm gold-plated plug, microphone (optional, on the VI version)
Accessories: Carrying case, silicon tips (2xS/4xM/2xL), Comply foam tips (4xM), cleaning tool

 

[jensigner]

(1) Is the HTC One headphone jack configuration exactly the same as the S3 (i.e. 3 pole with stereo out and a mic-input connection)?
(2) Who provides the default Music Player app on the S3 and is it the same one on the HTC One?

I like that default Music Player because it has built in support for streaming to "Nearby Devices", which Poweramp doesn't currently support, and is the default music player app different on the S4?

 

[rushmore]

The S3 sounds as good to me as my iPod5, so will be happy if S4 is the same.

 

[jensigner]

.. The supplied S3 earbuds sound horrible but the Creative ones are very good!

Well what I said her about the S3 buds is nonsense! I just didn't have the plastic tips in far enough (not used to those type of earbuds) so the S3 buds are very nice. Tons of volume at 10/15 with no sign of noise (with audio on pause) at 15/15.

 

[Reuben Chew]

Ok, so this is interesting. My headphones sounded like crap on the S4, not just mine, but I tested out two other display units at the sprint store, sounds the same on all of them. My headphones sound perfectly fine on all the other devices i tested (HTC One, Galaxy Note 2, Galaxy S3, and I was sure to enable the equalizer on all of them for a fair test.) I also tested like 6 other pairs of headphones that sound fine on the s4. Seems like it was just some weird combination of my headphones with that phone and my headphones. Very weird. I usually use Noozxoide but it sounds weird as well. I used the built in EQ since i was testing floor models though. I think it might have something to do with the impedance of the buds I had. They are 13 Ohm. Here are the specs and maybe someone else has issues with similar characteristics:

Ultimate Ears Super.Fi 5 Specs
Driver: single custom balanced armature, top-firing
Sensitivity: 115dB @ 1mW
Impedance: 13 Ohm @ 1kHz
Frequency range: 15Hz ? 15kHz
Cable: 120cm/46? (Y-style), straight 3.5mm gold-plated plug, microphone (optional, on the VI version)
Accessories: Carrying case, silicon tips (2xS/4xM/2xL), Comply foam tips (4xM), cleaning tool

I have the same issue with the UE600 (which is identical to the SF5). Other people have reported the same thing w other low impedance headphones. However, it's not a uniform problem. Someone I heard managed to do a 1-1 and the new set had no problem.

 

[jensigner]

I measured the stock earbuds that come with the S3 and S4. At 1 kHz, the earbud impedances are both 32-35 ohm which is very similar to my other Creative earbuds.
After some repeated careful listening to music on my S4 and switching between the S3 and S4 earbuds I can say that there is a HUGE difference in sound quality between these earbuds. The S3 buds have much better bass response! I read tin a review that the S3 and S4 earbuds are different but I'm wondering if there is something wrong with my S4 buds. They sound rather tinny to me. I switched plastic tips to see if there was any weird ear-resonance but they still sound "poor" imo. Can someone else veryify this difference?

 

[Reuben Chew]

I measured the stock earbuds that come with the S3 and S4. At 1 kHz, the earbud impedances are both 32-35 ohm which is very similar to my other Creative earbuds.
After some repeated careful listening to music on my S4 and switching between the S3 and S4 earbuds I can say that there is a HUGE difference in sound quality between these earbuds. The S3 buds have much better bass response! I read tin a review that the S3 and S4 earbuds are different but I'm wondering if there is something wrong with my S4 buds. They sound rather tinny to me. I switched plastic tips to see if there was any weird ear-resonance but they still sound "poor" imo. Can someone else veryify this difference?

I can't verify the 'difference' as I don't have an S3, but yes it feels tinny to me too. BTW how do you measure the earbud impedance?

 

[jensigner]

I can't verify the 'difference' as I don't have an S3, but yes it feels tinny to me too. BTW how do you measure the earbud impedance?

It turns out that it was the plastic tip on my S4 buds that was the problem. They weren't making a good resonant "seal" in my ear which leads to a lack of bass response. I know this by switching the plastic tip between S3 and S4 buds and they sound identical with the same plastic tip. For some reason, the plastic tips in my S4 are not the same material as my partners S3 tips. (I posted a comment on this issue separately). Will comment on the impedance measurement shortly.

 

[jensigner]

... So I was pretty disappointed when the GSMArena tests showed that the Galaxy S 4 suffered from lower quality audio, as well. (And happy as it meant my decision to not buy a phone was pretty much made for me.)

I found out today that they screwed up their test (and they received the final firmware update): Samsung Galaxy S4 review: Supernova - GSMArena.com
...".

As promised, I am starting to make independent RMAA measurements on my S4 (Canadian) and S3. Still checking the configuration (you need a post-amp after the earphone output to raise the level). Any idea what the nature of the problems mentioned above were in the early tests? I'm getting fairly poor crosstalk under 32 ohm headset load. Frequency response, noise and THD are all very good but not quite as good as the GSMArena results. I'll publish the results when my setup is fully characterized but this RMAA measurement with my soundcard shows my measurement capability: RMAA Blu-ray Player Measurement