I'd say if you're having an "argument," there's probably some anger, yelling, or some personal tension. A "debate" is more neutral. There might be yelling and emotions in a debate, but there won't be personal tension.
For example, my husband and I like to have deep "debates." We like to challenge each other's opinions, even if we agree, but we don't get angry. Sometimes, we become very passionate, so people watching might think we're "arguing."