Its more of a gesture than a long press for punctuation. Touch the period key and swipe right or left to see punctuation marks.
I tried it again the other day. A video online was showing the themes. So, I went to check it out. Guess what? No themes.I've been on SwiftKey about 4 years. I tried the stock keyboard when I hit my Note 8, I was back to SwiftKey ina day