You mean to say quickly, not fastly. Fastly is a rarely used word that modifies the an alternative meaning of fast, "to hold secure". For example "We hung the painting fastly to the wall". "Stand fast" (meaning "wait, don't do it yet") and "Stead fast" (meaning unchanging) are other phrases that use this definition of fast.