I have tried .mkv and .mp4 DRM-Free (I know 'cuz I made 'em myself) encoded with H.264 and I haven't had much luck playing them. Rockplayer (i think? i tried a bunch) had the most luck, but was useless with hardware encoding and stuttered on software encoding. Bummer. Good luck, and let me know if you find anything that works.