In the first one, the person who asks doesn´t know if the owner is among the people in the group and is asking if the owner is or is not in the group. We use "cuál" to select an object or person from a group or collection. In this case then, the person is asking who in the group is the owner, because one of them must be the owner.

They don't mean the same, there's a clear difference: hay un libro en la mesa, -alguno de ustedes es el dueño？ --> this means "is any of you the owner?", it doesn't know or assume that the owner is present. -cuál de ustedes es el dueño？--> this means "who (amongst you) is the owner?", assumes that the owner is present. Note that, at least in Spain, we would prefer to say "¿quién de ustedes es el dueño?". "quién" is "who", whereas "cuál" means "which one", which can be used for people or things.