Practise yourself regularly. When you practise and therefore you'll see the progress. You'll see that you're changing for the better everyday. I mean that ''little by little'' . When you think you're a (quite) good/acceptable speaker, you'll be more confident. Good luck ;)
P/s : I used to experience that feeling ;)