When the riddle is asked most people are thrown off by '' that man '' when this person could easily be 1 year old or 70 years old. In this case you have no brothers or sisters, but that man's father ( meaning you ) is also my father's son ( which is also you ). The only person '' that man '' can be is your own son.