I most often hear this sentence when people are referring to leaving their house. The Outside world is used to mean anything that is outside of your normal life, but it is mostly used when referring to people who have a very limited experience or don't take chances in their lives.

"The outside world" just means the world that is outside. It generally means somewhere a little far away. If I say"I want to see the outside world" it probably means I want to travel.