Lucifer couldn't believe what was happening; Rory is asking him to leave; is asking him to promise that he wouldn't change anything. He knows his calling feels right, but promising to abandon his child feels wrong . He wanted to do right by their daughter and agree to what she's currently asking, but it doesn't make sense.