I think the telephoto lens is one of those things where you probably won't miss it too much in day-to-day life , but if you do need it, you'll really miss it.
For myself, these situations are usually events you mentioned such as concerts or holidays. Even though these may only happen a few...