Interesting question. Down is easily the most common. For me downward is used in only specific contexts. I guess the best way to explain is by using examples where you use downward and not down: "The hill slopes downward" "Our country is on a downward trend" "Can you move the light downward?" Sorry I couldn't explain better. I hope that helps.