{"id":903883,"date":"2024-05-21T08:50:37","date_gmt":"2024-05-21T12:50:37","guid":{"rendered":"https:\/\/glaad.org\/?page_id=903883"},"modified":"2024-05-21T08:50:51","modified_gmt":"2024-05-21T12:50:51","slug":"focus-on-ai-2024-social-media-safety-index","status":"publish","type":"page","link":"https:\/\/glaad.org\/smsi\/2024\/focus-on-ai\/","title":{"rendered":"Focus on AI – 2024 Social Media Safety Index"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

2024 Social Media Safety Index<\/h1>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Focus on AI: Risks for LGBTQ People<\/h2>

\u201cAI will always fail LGBTQ people.\u201d
<\/em><\/strong>\u2014 Mary L. Gray, Senior Principal Researcher, Microsoft Research<\/a><\/p>

\"A
Gender Spectrum Collection<\/figcaption><\/figure>

While in the last decade, artificial intelligence (AI) technology has had many positive aspects, as it has accelerated and become more widespread<\/a>, it has also elicited concerns from human rights advocates about an array of dangers and risks<\/a> particularly for marginalized communities. Experts<\/a> such as Joy Buolamwini<\/a>, Timnit Gebru<\/a>, Latanya Sweeney<\/a>, and others have sounded the alarm regarding large-scale issues of algorithmic bias and AI-facilitated disinformation campaigns, including deepfakes<\/a>. In April 2024, more than 200 civil society organizations including Free Press, Color of Change, and GLAAD sent an open letter<\/a> to the CEOs of 12 major tech companies, urging them to adopt more aggressive policies to mitigate dangerous, AI-fueled political propaganda leading up to the U.S. presidential election. The letter achieved some initial impact, with eight of the 12 companies issuing responses; committed to maintaining ongoing pressure, organizers were clear<\/a> that much more action is needed as \u201cplatforms evade their responsibility to users around the world.\u201d Various civil society efforts continue<\/a> to hold companies to account.<\/p>

While many fears circle AI\u2019s future<\/em> capabilities, today, generative AI (which encompasses technologies like image generators<\/a> and large language models<\/a>) already poses unique risks for marginalized groups<\/a>, including LGBTQ people. For one, several studies have illuminated fundamental bias<\/a> baked into AI within natural language processing, facial and image recognition, and recommendation systems \u2014 which can have real-world implications. Access Now explains<\/a>: \u201cCompanies and governments are already using AI systems to make decisions that lead to discrimination<\/a>. When police or government officials rely on them to determine who they should watch, interrogate, or arrest \u2014 or even \u2018predict\u2019 who will violate the law in the future \u2014 there are serious and sometimes fatal consequences.\u201d<\/p>

Generative AI systems learn from existing data, which may also contain harmful stereotypes<\/a> about LGBTQ people, misrepresenting diverse experiences within the community. (An April 2024 investigation<\/a> by Wired<\/em>, for example, found that many AI tools, like OpenAI\u2019s Sora, tended to portray LGBTQ people as white, young, and with purple hair.) In recent years, some companies have developed \u201cautomated gender recognition\u201d<\/a> (AGR) technology, which claims to predict a person\u2019s gender (often to sell them products via targeted advertising). Spotify\u2019s 2021 patent, for example, claims<\/a> to be able to detect<\/a>, among other things, \u201cemotional state, gender, age, or accent\u201d to recommend music. For trans, nonbinary, and gender non-conforming individuals, and others with genders that fall outside the binary, this technology is particularly problematic. Access Now\u2019s Daniel Leufer writes<\/a>: \u201cResearch shows that AGR technology based on facial recognition is almost guaranteed to misgender trans people and inherently discriminates against non-binary people. As Os Keyes explains in their paper, The Misgendering Machines: Trans\/HCI Implications of Automatic Gender Recognition<\/em><\/a>, approaches to AGR are typically based on a male-female gender binary and derive gender from physical traits; this means that trans people are often misgendered, while non-binary people are forced into a binary that undermines their gender identities.\u201d<\/p>

In addition, social media platforms are automating<\/a> content moderation processes, and many large platforms<\/a> are using AI<\/a> to decide<\/a> whether content violates or doesn\u2019t violate their hate speech and harassment policies. In recent years, many social media companies have reduced<\/a> vital trust and safety teams<\/a>, often opting to contract<\/a> with third-party vendors<\/a> that fail to adequately recognize<\/a> and understand<\/a> harmful content targeting marginalized groups. In a 2021 study<\/a>, for example, MIT Technology Review<\/em> reported<\/a> that \u201cscientists tested four of the best AI systems for detecting hate speech and found that all of them struggled in different ways to distinguish toxic and innocuous sentences.\u201d<\/p>

Some of the world\u2019s largest social media platforms have shown they are not equipped to handle the rise of AI-facilitated hate, harassment<\/a>, and disinformation<\/a> campaigns<\/a>, including deepfakes<\/a> and bots that can spew hate-based imagery<\/a> at massive scale<\/a>. In a July 2023 paper, Mozilla researchers wrote<\/a>: \u201cThis research shows scale degrades datasets further, amplifying bias and causing real-world harm.\u201d The New York Times<\/em> also reports<\/a>: \u201cIn the hands of anonymous internet users, A.I. tools can create waves of harassing and racist material. It\u2019s already happening on the anonymous message board 4chan.\u201d In one example, from May 2023, a deepfake video<\/a> of President Biden in drag (with anti-trans overtones) went viral on Instagram and TikTok (many instances of the post are still live on both platforms). Another altered video<\/a> in February 2023 showed Biden making transphobic remarks in a speech. (It was fake.)<\/p>

Thankfully, some tech companies are starting to recognize that they must make at least some effort to address the risks of generative AI on trust and safety. In January 2024, Meta started requiring<\/a> disclosures for AI-created or altered political ads<\/a>, and in February 2024, the company said it would begin labeling <\/a>AI-generated images, audio, and videos.. Similarly, in March 2024, YouTube began requiring<\/a> creators to disclose when they make realistic videos with AI. It remains unclear whether these measures will be effective at scale.<\/p>

People are impacted by these tools, and addressing these risks requires collaboration between technologists, policymakers, LGBTQ advocates, and other stakeholders to pursue safeguards to help prevent malicious use and unintended consequences. Ensuring compliance with existing anti-discrimination laws and developing regulatory safeguards to address emerging risks will be essential for protecting the rights and well-being of LGBTQ people and other marginalized groups. As Tech Policy Press notes<\/a>, in the US, there is no federal legislation close to becoming law. But in the past year, there has been a surge of AI laws proposed and passed, and some have already taken effect. In October 2023, the Biden Administration issued<\/a> an executive order on \u201csafe, secure, and trustworthy\u201d AI, which provides an ambitious blueprint<\/a>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Continue Reading<\/a>…<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t

\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Table of Contents<\/h2>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t