My lunch time in office

Whenever I think about the incidents of my office i.e. lunch time hour, I feel laughing like rolling on floor.
Actually, in my team there are male colleagues and when its time for my lunch, my female colleagues from other department call me to join them for lunch. So ppls of my team gets jealous to see me having lunch with bunch of ladies and that too alone me only and no other guy was there with those ladies.. Haha...

So everyday, once it's passes 12 pm, ppl starts asking me--- So today again you'll go with those ladies for lunch???.
And everyday, my answer was YES..
Few of my department ppl started asking me that, we were working in department and company for more than 2 yrs but nobody ask us for launch, the way you were been asked so. You haven't even completed 1 yr in this company and everyone knows you very well, how????