He likes you. He might not know it but he does. Do you like him in that way? If you don't, maybe you should think about backing away for a bit.
Would you be comfortable with your boyfriend acting this way around another girl? Whilst it isn't your fault, you do have the means to stop it from happening.