Well, in my opinion, the first sentence with "zai" suggests it's a short-period action, like you have been studying Chinese for 2 hours; But the second suggests that you have been studying Chinese for maybe several years. However, I think in many cases, they don't have much difference, and no matter you add "zai" or not, you can be understood.