No, you cannot. You should say something like “I’m going to swim or take a dip in the water, get into the water”.Take a bath is only used to indicate you’re washing yourself in a bathtub.