It does matter。 You can do them simultaneously. Your reading and your speaking are interdependent. If make progress in reading, then your speaking will be benefited, too, and vice versa.

i think learning how to speak is much more important,because you can learn how to say and what to say from others' speak.words in papels sometimes are too oficial and is not that helpful in social life.but when you have speaked with others for a while ,you can do both together.

listening and speaking can be expressed by pinyin which is made of Latin letters and tone signs one day is enough to understand the general concept while reading and writing means memorizing Chinese symbols you should learn how to listen, speak, read and write same time

Learn speak firstly.