Attraction is attraction and just because someone told another your address and said theres a party over there, doesn't mean that man was some..weird guy necessarily.
When I was in highschool someone would always tell me there was a kickass party over at so and so address. I wouldn't hesitate to run myself over there at 9 at night to check it out.
If someone said there was a hot babe at so and so and was interested, I would probably go over there aswell. I still don't see that as much a grudge to hold.