I feel your pain.
I have the Samsung Galaxy S4 Red. I've cleared ram (twice), shut down apps with android app killer (twice), and went to each downloaded app and cleared cache (watch facebook...that keeps a lot in cache). I still have ram at 1.68/1.78gb with only wifi, sound, screen rotation...