It may be harmless - depending on how they made the pass - so don't worry about it - they should be more embarassed than you.
But be careful they should know better, if it becomes a problem and they try again, then simply calmly explain no and do not over react be the professional one then nothing can be turned around on you later.