The sentence is grammatically correct but (depending on which part of the world in which you're based) it may sound elevated in tone (diction). If you want the sentence to sound more "natural," in the sense of more casual, spoken English, try this: "Harry went on to punch the man several times, with the people around him joining in."