I like to have my cake and eat it too
You want to get your kicks and not get caught. Like when you're with someone, you don't want to be in a relationship, but you still don’t want them to leave.
She kept hanging out with her ex but still called him a loser.
He had a girlfriend and still asked every girl out.
She said she wanted a relationship but still dated her ex.