When on the main screen that shows all your messages, you should be able to swipe left or right to delete all messages from a single contact. There could also be an undo prompt that shows up on the screen until the next action is taken in case the delete was accidental. Having to confirm the delete is kind of annoying. The way the gmail app lets you swipe to delete is preferable .