In this sentence, "very" is an adjective that means "being such in the true or fullest sense of the term" or "precisely as stated" (definitions from online dictionary). It basically stresses that when you say "at the very beginning," you do not mean five seconds after the beginning, but precisely at the beginning.