That is heavy. Have your family ever took those white folks to court for owning your grandfather?
How would they do so when they owned him legally? Slavery was a legal institution in the United States. So the white family was operating within their legal rights. Additionally, it would be hard to hold the current generation of a family responsible for the ownership of
property that was legally acquired and possessed by a relative that lived 200 years ago. If anything, enslaved families would need to sue the US Government for the legalization of an institution that perpetuated human rights violations against them. The government is who you would go after, not the family.
Additionally, my 2nd great grandfather was educated and given land by his white father. Because many Georgia landowners were in debt to his father and defaulted because of the war, their land was made collateral and confiscated. His father acquired land all around Atlanta and the surrounding counties. The land that was acquired in Cobb County was given to my 2nd great-grandfather (Cobb County was the furthest away from where the white family lived on the opposite side of Atlanta in Monroe, GA which is in Walton County (There is also a story that he killed a white man near Monroe and that his father sent him to Cobb to save him from being killed by a mob)). That bequest of land in addition to a series of successful businesses made my 2nd great-grandfather, along with his son-in-law, the wealthiest black men in Cobb County, Georgia before the Great Depression (they lost much of their wealth).
They say the best revenge is success. The current branch of the black side of our family in Atlanta is just as successful as the white side. Both sides are currently banking and merchant powerhouses in the city. Not only that, the white side acknowledges that there is a black side of the family, apologized back in the 60's, invited the black side of the family to family reunions (my great grandfather used to attend in the 70's) and includes the black branches of the family in their history books.
So land was given to the black son. White side apologized and acknowledges the black side. And also white side includes the black side in their history books and family reunions. You can't really expect much more than that to be honest.
And just fyi, this is not some rosy tale of reconciliation between whites and blacks. My 2nd great grandfather
HATED white people to the grave. So much so that he named my great grandfather after
John Brown. And even he hated white people. He killed a white man and had to be smuggled out of Atlanta to Chicago.