I am not 100% sure, but I am fairly certain the Dalvik cache (Dalvik is the name of the Java VM for Android, what most apps run on) is basically a bytecode cache of an application after it's processed by Dalvik.
Long story short, once an app is cached in that way, it should have faster startup times and such.