Well, there is nothing to fix. As long as the speakers are picked based on their content, everything is fine. But OP suggests we pick speakers based on their skin color... that's fucked up.
Noone is saying that you should pick someone only based on the skin color.
The idea is to bring people, that for some reason is being marginalized by the community in general, to speak.
Like the person above mention "where are all the people different from us?".
The world is composed roughly by 50% female? Why are not there 50% in CS as well?
You cant balance it. In order to balance it, you already have to put these people into certain boxes, which is already pretty offensive. Then you'll have to descriminate against people in certain boxes in order to balance it. ITS WRONG. Stop grouping people up based on their skin color or sex or whatever. stop it.
“Women can’t face widespread harassment which pushes them away from tech conferences, because gender is a social construct, and thus there is no such thing as ‘women’, and thus we don’t have a problem so stop complaining about it”
Like the person above mention "where are all the people different from us?". The world is composed roughly by 50% female? Why are not there 50% in CS as well?