This depends on the context. Maybe you are speaking about a race of some kind. Saying "They all set off at once" means that all of the participants in the race started at the same time. Set off means to "embark" or "go" as in, on a path, journey, or adventure. "At once" simply means "at the same time" or "in the same moment." I hope that this helps!