Well that's not a good habit in fact every secondary language learner does that mistake.You should avoid it.
You should first improve your speaking skill, whatever comes to your mind just through out and try to think in English. when you'll be able to speak fluently with grammar mistakes then start working on your grammar.