I think it's mostly illusion.
I trust what the US National Institutes of Health say about this. They have an article about it:
The basic message is "Most individuals can get all of the necessary vitamins and minerals through a healthy eating pattern of nutrient-dense foods."
The discovery of vitamins in the early 1900s was important. The identification of vitamin deficiency diseases was important. Improvement of public health by fortifying certain foods was important: milk with vitamin D, rice with B vitamins, table salt with iodine, and so on.
The idea of taking a multivitamin every day "just to be sure" is probably a harmless waste of money. I used to do it. Because of more and more articles--like the NIH article--saying that it isn't necessary, I've stopped.
The idea that if vitamins are good, more most be better, is wrong. Extreme cases of people of people using "megavitamins," far exceeding the recommended daily allowance, can be unhealthy. Vitamin A overdose, for example, can be serious.
Now, if a doctor has actually confirmed a deficiency, then I think it makes sense to take vitamins. At one point, a doctor did a blood test and noticed that I was low on vitamin B12 and had me specifically take a B12 supplement. That makes sense. I know someone with macular degeneration whose eye doctor told her to take a specific vitamin preparation, the AREDS formulation, which is thought to slow the progress of macular degeneration. That makes sense, too.