"De är små och stora" is kind of a strange answer to that question. I guess you can understand it as you suggested, but a more correct answer would then be "Det finns både stora och små" (There are both big ones and small ones) or "Vissa är små och andra större" (Some are small and others are bigger).