Some conversations die off and there is no conversation with that contact again. Typically they go down in the main list. A filter by conversation age that is by last message date in that conversation will help identify such conversations and help clean them.