Wikipedia has some nice info on surnames.
The easy explanation is this: They didn't exist back then! At least not in the same sense as today.
In those old times they usually used your ancestor to adress you in other ways than your first name. E.g. Son of David.