Assalamu alaikum. Listening skills come with time. You just have to be continue listening regularly. Gradually, with time, you'll be able to understand more and more. I used to face similar problems a few years ago but now I have improved (although, still, there are occasions when I find difficulty in understanding some accents).
Depending on what your level is, you can use any of these tips:
1) Listen to English audios that are meant for teaching: These audios are recorded in a way that is easier to understand (usually they speak slow, using standard and formal pronunciations).
2) Choose an accent: As you would know, English is spoken in a variety of accents that can vary even in the same country. It would be better for a beginner to choose one of them (e.g. standard American accent) and get comfortable with it first before listening to other accents
3) Make use of subtitles: You can listen to those videos that have subtitles (or there's also an option in YouTube that generates subtitles). This can help you to understand words that you couldn't pick up while hearing.