Yes, I think I agree that it's best to leave both Bluetooth scsnning and Wifi scanning on, since they don't use that much battery and improve location accuracy.
I'm not sure if you did turn Location Services Bluetooth Scanning off, but had the Find My Device using crowd-sourced network settings turned on, would the device still be doing Bluetooth scanning to allow the location finding offline?