'Is this a mistake from you?'

This would mean that you are unsure whether to it is a mistake or not. So the question being asked is about the occurence of the act, a mistake in this case.

'Is this a mistake of you?'

This is incorrect.

'Is this mistake yours?'

This would mean that you are sure that it is a mistake, but unsure who did it. So you are asking whether it was done by the person asked or someone else.