There's some confusion regarding 'cache' that needs to clarified. There are two separate and unrelated caches you're referring to as one.
-- As far as the system cache partition, the internal storage memory of your mobile device has several different partitions set up on it. Most are operating system related and you as a user don't interact with them in a direct way (unless you root your device and then intentionally do so). One of those partitions is the system cache, a partition dedicated solely to the operating system and its functionality. You won't interact with it directly in any way, except to maybe occasionally wipe it clean which typically involves rebooting your device into its Recovery Mode.
-- The individual app caches are tied to their respective apps. One of those partitions referred to above is the /data partition, that's where all your personal data, the apps you install yourself, and the general user settings and preferences are all stored. This general user data partition is the one that you interact with each time you use your phone. Wiping each app's cache will only affect that app. And no, your files, photos, music, etc. are not affected. The cache is all temporary and non-vital data. But as a 'for instance', with the Google Photos app if you wipe the cache, this again doesn't delete any of your photos but what it will do is force the app to rebuild its cache, in this case it needs to re-index all thumbnail images of photo library. The thumbnails being those tiny, representative images of the actual, full-sized images. So for those who constantly wipe their app caches on a regular basis, take note that you're actually just making your phone work harder as all the apps rely on their caches to function.
So keep a distinction between the two types of caches -- the system cache partition is related directly to the operating system, the app caches to their respective apps. When you're trying to diagnose some problem don't confuse the two, and while it doesn't necessarily hurt to just wipe them clean, unless you have a reason to, it doesn't help either.
As a semi-related tip, when you're going to uninstall an app, in order to 'completely' remove it don't just tap the 'Uninstall' button. For a lot of apps that only removes the 'app' itself but its settings and configuration options will remain. That's why for some apps if you uninstall and then later decide to reinstall you don't need to go through the process of adding your user name/password.
To completely remove an app, tap the 'Force stop' button, then the 'Clear data' button, and then the 'Uninstall' button. By using 'Clear data' that wipes the app's cache and its settings.