Hi Stelio,
Can you be more specific? Often what some learners and other observers mean by “American English speakers* don’t seem fluent” is that they use slang and other types of colloquial, informal speech. Traditionally, on the other hand, many English learners have been taught a more formal, educated level of the language. And if those learners are educated professionals in their native language already, they have access to more specialized vocabulary than an American English speaker who has only a secondary school diploma (which is still the majority of speakers).
Add to this the ideas that dominate the US public education system, which produce people who lack general knowledge. If someone lacks knowledge, they’ll lack the vocabulary that goes with that knowledge. Is that what you mean?
If you mean speakers pausing to choose a precise word or phrase, that is often a sign of education and good speaking/clear thinking ability, as well as respect for language. Barack Obama often paused when he spoke directly to smaller groups, because he was careful with his word choice. Which is a good thing in a powerful leader, I think you might agree.
*I think you are referring to American English here. But the native languages of many Americans include Spanish, Tagalog, Vietnamese, and so on.