Detecting hate speech on the Internet
Online bullying and trolls are the darker side of social media. Twitter's Chief Executive Officer 聽that he wanted聽to make聽it a corporate priority to聽detect聽abuse and hate speech on Twitter. And yet only a month ago,聽"Ghostbusters"聽star Leslie Jones , a demonstration of how difficult it is to detect聽such abuse by automated means.
But there is good news. Yahoo has developed an algorithm that combined conventional keyword searches聽with more sophisticated machine learning techniques to detect more subtle examples of hate speech. They use word embeddings ()聽to聽convert a聽message聽into a vector, and聽then compare the vector of the message to known cases of hate speech. Their technique allowed them to reach an F-score of 0.783 and an AUC of 0.9055.听Read their paper or an article summarizing their paper .听