Either can be right. "Do you know the difference between the two books" is a general question about how the books differ overall and you would probably expect a short answer - e.g. "One of the books is a novel, the other is a biography." "Do you know the differences between the two books" sounds like it is asking for more detail and you would expect more than one difference to be mentioned in the answer.

Both are correct