yes you're right. it's nothing far different. in this case "면" has a meaning like "IF" as you mentioned.
so 저녁늦게면 아무때나 "could" be considered like, "IF we can meet in the evening, i'm okay on anytime, but if we have to meet in the morning or afternoon, I need to consider"
and 저녁늦게 아무때나 "could" be considered like, "I'm free in the evening, other time may not be possible"