Seems to be a recurring issue on Android phones of late. My own Galaxy S3 included.
Can vouch for the fact that a cache wipe helped with performance.
I'd recommend giving CCleaner a go. It does more than just wipe the cache and gives you a good breakdown of where your ran is being eaten up :)