I don't think it's a term of endearment. It's a comment, if I'm in a witty moment I might have responded "but not the way I move?"
If he didn't catch the reference I would be disappointed. If he responded "that's what I like most of all"
Wit match, 100 bonus points. He'd need to be really deficient elsewhere to put me off.