My answer to your first question would be:
Your level of understanding gets better as the practice goes on. What you need to do to improve your listening skill in English are the following:
▶Read book to enhance your vocabulary, the moment you get to learn more words, the more you understand what others will say.
▶Watch movies with subtitle. This allows you to listen to the words while you see them. It's very helpful as you'll get used to hearing a speicific accent. People have different accents and it varies per nationality.
Now, the second answer would be:
It's tough to remember everything most especially if you are reading or listening to a long passage. Just don't mind the words you see or listen to. Remember, what's important, is you get what the article is about. Understanding articles or passages is better than remembering the words.
Now, if you'd really like to take down notes, then it would be easier if you just write the words you have difficulty understanding. You can get back to it after you finish reading or listening to articles or passages.