Jim didn't die. Sebastian knew that. But now, he wished Jim had died. What's more painful? Your lover being dead, or your lover living, breathing, but not remembering the love you two had? Jim doesn't remember anything before the fall. Not Sebastian, not Sherlock, none of it.