1. What were you wearing?
2. How did you look (other than clothes)?
3. Did you have a bad posture or were you sitting on the ground?
... maybe the old man got into an argument with his nephew, who was a gamer, and once again asked for money for a game rather than getting a job to earn it. ...and he just took it out on you.
...but he's right, people don't randomly just walk up to you and insult you in your face... unless they're crazy...
...was he crazy?