I know it's anecdotal but I've asked my colleagues the same - in a country with a terrible history of this sort too. And turns out I can't find a single person who agrees with Github's decision.
Almost everybody has ancestors that were enslaved. E.g. most Germanic people where enslaved by other Germanic people, or the Romans at some point in time. The only question is how far back you have to look and how far back you can look.
When you think about masters/slaves, do you think about black people only? If so, why?
There are countless examples in the history of the world about slaves, including different ethnics, in every continent. May they have a word on this issue too?
Throughout history, various races struggled from slavery, pretty much the entire spectrum is fully covered across the world. Nowadays there are more people in slavery than at any given time before.
Slavery in Russian empire was de jure abolished about the same time as slavery in US. Not surprisingly, it took even more time for "de facto" changes to happen with various restrictions still being a thing into 1970ies. If anything, kolhoz system was anything but slavery with the government being ultimate owner.