That's correct, it's simply a way of saying that you don't know something. For example, if anyone asks you if there is a pharmacy nearby, you can answer by saying "Not that I know of", meaning that there might be a pharmacy nearby, but you are not sure about it.