I actually never use people's names in the conversation, so it's not an issue for me. (I'm not sure why. I just don't, despite the fact that I know that this is something that will let you gain many friends and be surrounded by people who want to hang out with you. Wait, this may be the reason...)
But I'd say that one should at least try to pronounce it correctly and only when this approach fails (you can't pronounce given sounds) they should either stop using it (replace it with "hey you". Kidding.) or ask for a substitute (something similar, but not that hard to pronounce).
Another interesting thing is the pronunciation of the names of famous people. In the UK, they pronounce Szczęsny (a football player) as Shezny, because they simply can't do this properly. (This is so inaccurate that if I didn't know who the guy is, I would have never guessed.) And I don't think he's offended.