If you're having trouble tracking down your Grandfather it may have been because your father was born out of wedlock. In the old days, mother's often used to give a clue as to the name of the father by giving the child the man's surname as a middle name (especially boys).