Yes, you can say that the city is small. That is correct English, but it won't tell anyone whether you mean small in area or small in population. It could be either or both. Common ways to make it clear would be to say that "the city covers a small area" or "the city occupies a small area" or just that "the city is geographically small."