but I'm not quite sure he thinks of it as being worthy of love? I don't really see him thinking in those terms ...

Yeah, agreed. I don't think Kunlun ever gave him the impression that love was conditional (quite the opposite! he arrived, saved Shen Wei's life, and then showered him with compliments and affection), so I don't know where that would have come from...