Very short answer is not a very polite way of answering. You should use such expressions with your friends or family only. If you say someone you don't know, answering this way sounds not only very impolite but very rude sometimes. Even you add -요 after the answer, still it doesn't look good to show your respect to the person. So I suggest you should use full sentence with honorific forms when you speak to someone you don't know.