I would interpret that as a
"Leave me alone I'm not interested"
Maybe it's just how I view things, but you realize every relationship ends in either break up or marriage? Like I'm engaged and 95% of my time with my partner is just casual hanging out. I would be distraught if I could only see them when were on a date.
You need to have a better conversation with him.

There's a really bad king Arthur movie I watched while in college and it was bad in a lot of ways.
But Arthur was a roman and the armor was correct.