Language is indeed an indication of origin. Most people who speak native Spanish, for example, are part Spanaird (think about it).
I don't know about this but the history of Swahili says it originates in Kenya and Tanzania, and had no Arabic input until later.
Where does it say this? The word Swahili means coast in Arabic referring to the East Afrikan coast.