Most people have no idea how complex their words are to non-natives. Especially when it comes to things like phrasal verbs, which natives use effortlessly and which perplex even the most advanced students. To a native, phrasal verbs are short words which should be simple to understand and therefore get peppered in to a discussion liberally when they are trying to communicate ''simply''. They don't actually know what a phrasal verb even is.
This is just one small example. The same applies to any other grammar point you choose to mention (but most notably for modal verbs based in the past... ''He should've gone to the supermarket yesterday'' for example which appear to be obvious but which have many underlying and subtle meanings which make their usage impenetrable for many).
On top of all this, you have a native who chooses each and every word they speak for a purpose. I am no different. I choose my words extremely carefully to convey a specific meaning. I try not to use confusing vocabulary because English is about communication, but there's no denying that there are many layers of subtle meaning to even the most basic of sentences. English for me is a very precise language where every word, every grammar choice, consciously or subconsciously counts. Each word carries a huge weight of meaning.
Add again the different levels of stress, tonality and rhythm as I speak, all of which convey their own meanings, and you can see we have a major problem (not to mention that students are incorrectly told that tone does not matter in English).
That's all :). I can ramble all day but i ran out of time, sorry... !
The point is there's no easy answer to this other than to continually challenge ourselves each and every day to speak more precisely, more accurately, with more meaning and subtext. It's a skill that can be learnt but which is extremely difficult.
(context: i'm a native speaker and an English teacher, although not in italki. I'm just here to learn Spanish!)