They agreed on a summer fling, but can they really let each other go?