I think you should not restrict it at all (meaning: setting the limit at a very high level). It is hard, if not impossible, to determine how long the fields should be, but they cannot be too short, that's for sure. Names, cities, streets can be really long. Just check these to get some perspective:
Longest place names in the world:
Longest street names in the world:
Hey, my country wins! :)
For the longest surname check:
There is a world record on it!
The argument of not letting users paste too much is important to some extent, but I don't really think it is going to cause more problems than too short fields to enter data.