The Arabic language dates back to 5000 years ago. "Date back to" is the correct idiom. Another example is, "The archeologists found jewelry dating back to the 1500s." Whether to choose "dating back to" or "dates back to" comes down to the part of speech it is modifying. If used as an adjective, "dating back to" is correct.