Good question.
I would say that perdón is slightly more informal. You could use it if you accidentally bump into someone, in a crowd for example.
Perdone and perdona would be more formal than perdón and would most often be followed by a sentence. For example, "Excuse me but is this the 4th floor?", "¿Perdone, pero es esto el cuarto piso?".
Now between perdone and perdona, perdone is the most formal, and is the Usted version of the verb. You would use this in any formal situation. You could be questioning something your boss said or asking someone you do not know a question. Perdona would be used more with someone you know.
Really, in some cases all three could be used. Whichever you choose changes the tone a bit of the conversation.