Biblically speaking, not really. Ham is the progenitor (father) of the dark races, which are the Africans. Negroes however, are not descendants of Ham, we are descendant of Shem. From Zondervan Bible Dictionary-
The Negro in America being African is one of the greatest lies that has ever been told. Now, Israel (some, maybe even most) lived in Africa for centuries so they probably did mix with Africans to an extent. The seedline is carried through the father though, so if the father was an Israelite and the mother was an African, the child is an Israelite. If it's vice versa, then no. But, we were commanded from Yahawah (God) to not mix with them, or anyone else. We were supposed to stay within the 12 tribes. There were certain times Yahawah allowed us to take wives of other nations, but we are supposed to stay holy (separate).
Deuteronomy 7:1-6
As far as whether the Chaldeans were Africans, I'd have to check because I don't know off-hand.