“Of” is a preposition and therefore needs to be followed by a noun or gerund. “Driving” here is a gerund. It acts as a noun and refers to the act of driving.
Strictly speaking, gerunds should be preceded by a possessive pronoun and not an object pronoun: “his driving”. But it’s become so common to use the object pronoun that it’s perceived as correct by many native speakers. I think this is where the confusion comes from. The pronoun is attached to the gerund and not the preposition. It forms a possessive. Because of this, there has to be a noun or a gerund that’s attached to the preposition. The scene is of the act of driving of his.