The first is simple past tense, the second is past perfect tense, they are essentially both perfectly fine and it really depends on what you say in the rest of your sentence. But just off the top of my head, I would suggest the first: "I knew, I made a terrible mistake".