Nevermind, I figured out a solution to the problem. I had installed the latest version of Firechat, a messaging app that uses Bluetooth to communicate. When I uninstalled it, my Bluetooth stopped turning on automatically (this was never a problem before the Firechat update).