After searching the whole day I found this:
https://code.google.com/p/android/issues/detail?id=64267
It says the HTTP headers need to be set properly in order for the download manager to recognize the file, even if the extension is ".pdf", so I tried that with a PHP based website I am...