Ofc, you would. If anything, this is an indictment of the lawmakers who wrote the legislation that funded the program.
Yes, it's the literal definition of racist to single out one race for benefit. It should have never been written that way, Law is intended to be precise. See below.
Our legal designation is "[American] freedmen."
CHAP. XC.–
An Act to establish a Bureau for the Relief of Freedmen and Refugees.
Be it enacted by the Senate and House of Representatives of the United States of America in Congress assembled, That there is hereby established in the War Department, to continue during the present war of rebellion, and for one year thereafter, a bureau of refugees, freedmen, and abandoned lands, to which shall be committed, as hereinafter provided, the supervision and management of all abandoned lands, and the control of all subjects relating to
refugees and freedmen from rebel states, or from any district of country within the territory embraced in the operations of the army, under such rules and regulations as may be prescribed by the head of the bureau and approved by the President.
In March 1863, the U.S. Congress created a new agency within the War Department, the Bureau of Refugees, Freedmen and Abandoned Lands
www.freedmen.umd.edu