The speaker is implying that whatever "that" refers to (a joke, a phrase, an insight, etc.) is something that his/her father would not understand at all. (His father would not "get" the joke or would not really "grasp" the concept of the subject).