If being called by your name caused your heart to beat fast, then it's better to say: When I heard my name, my heart started beating so quickly But if your heart was already beating fast before you called, then you should say: My heart was beating so quickly when I heard my name.

When I heard my name my heart was beating so quickly.

Thanks

A popular saying is 'my heart skipped a beat' :)