Alice, that's a very common situation. I'd go so far as to say it's universal. To use a rather old fashioned phrase, speaking is a different kettle of fish compared to passive forms such as reading and writing. One can translate written stuff and revise or reverse translate when writing, all in privacy. None of that works while actually speaking.
One either understands an accent or one struggles. One either knows the words and the idiom or one doesn't. One can either think in the target language and respond naturally and spontaneously to what one hears or one can't. Moreover, the very presence of the other person (a native speaker or at least someone far better versed in the language than oneself by definition) is in itself intimidating, even if that presence is virtual.
Fear of ridicule or rejection is the most universal fear of humankind. This is a version of that same thing. It's why toddlers pick up their native language with consummate ease. They aren't grown up enough to have that ridiculous fear of ridicule that plagues adults.