I'm assuming you've done the usual tricks already (lower screen brightness, turn of LTE or HSPA+ when not needed, turn off bluetooth and GPS when not using them, lower the time your apps refresh or poll for new data, etc)
Those things alone will do a LOT. Let's say for example you use Facebook with 200 friends. Facebook app defaults to refresh every hour... that right there is a lot of data to be polling every hour. Same thing with other social media sites, and you might want to reduce the refresh time on weather apps as well.
The other thing that may play into your battery life is how many widgets you have running, and how often THOSE refresh.
Other then that I'd say throttle your CPU somewhat, and look into other ROMs to see which has the best battery life.
Sadly it comes down to balance. Lots of features and extras and apps polling for data is super convinent but hard on the battery. Turning all that stuff off makes a "smartphone" far less smart and useful, but really takes a load off of the battery.
It could also be that the battery is getting old (depending on how long you've had the device and your previous usage and charging habits)
I don't have a Note but I've got a Galaxy Nexus which has terrible battery life. All these things are stuff that I've found helps somewhat.