I think it depends on your native language, so I think most of us would say it's Chinese Language or Japanese because these languages have different structure and different logic,
I speak Arabic and learned English and German and some French
I found German is the most difficult.