I understand it, although I think it's quite colloquial. "Use my phone" would imply using it as a phone for making calls/texts etc., "going on my phone" sounds to me like using my phone for playing games or browsing the internet - generally to waste time.