'The cream of something' means the very best examples of it, so yes, it is like saying the elite.
A fete is an outdoor event like a garden party. Fate (pronounced the same way) means destiny - what will happen to us. I think this is the meaning you need.
'When we reach adulthood, fate will take us in different directions' or you could say 'When we become adults, we'll follow different paths through life.'