You might be able to remove the Amazon account under 'Accounts & Sync' in System Settings, but then that will probably remove syncing to all of your Amazon services, which might not be optimal.
So yeah, I think disabling the amazon mp3 app would be your best bet if you don't plan on using it at all.