Alt-right pipeline
The alt-right pipeline (also called the alt-right rabbit hole) is a proposed conceptual model regarding internet radicalization toward the alt-right movement. It describes a phenomenon in which consuming provocative right-wing political content, such as antifeminist or anti-SJW ideas, gradually increases exposure to the alt-right or similar far-right politics. It posits that this interaction takes place due to the interconnected nature of political commentators and online communities, allowing members of one audience or community to discover more extreme groups.[1][2] This process is most commonly associated with and has been documented on the video platform YouTube, and is largely faceted by the method in which algorithms on various social media platforms function through the process recommending content that is similar to what users engage with, but can quickly lead users down rabbit-holes.[2][3][4]
Many political movements have been associated with the pipeline concept. The intellectual dark web,[2] libertarianism,[5] the men's rights movement,[6] and the alt-lite movement[2] have all been identified as possibly introducing audiences to alt-right ideas. Audiences that seek out and are willing to accept extreme content in this fashion typically consist of young men, commonly those that experience significant loneliness and seek belonging or meaning.[7] In an attempt to find community and belonging, message boards that are often proliferated with hard right social commentary, such as 4chan and 8chan, have been well documented in their importance in the radicalization process.[8]
The alt-right pipeline may be a contributing factor to domestic terrorism.[9][10] Many social media platforms have acknowledged this path of radicalization and have taken measures to prevent it, including the removal of extremist figures and rules against hate speech and misinformation.[3][7] Left-wing movements, such as BreadTube, also oppose the alt-right pipeline and "seek to create a 'leftist pipeline' as a counterforce to the alt-right pipeline."[11]
The effects of YouTube's algorithmic bias in radicalizing users has been replicated by one study,[2][12][13][14] while two other studies have found little or no evidence of a radicalization process.[3][15][16]
Process
Use of the internet allows individuals with heterodox beliefs to alter their environment, which in turn has transformative effects on the user. Influence from external sources such as the internet can be gradual so that the individual is not immediately aware of their changing understanding or surroundings. Members of the alt-right refer to this radicalization process as "taking the red pill" in reference to the method of immediately achieving greater awareness in The Matrix. This is in contrast to the gradual nature of radicalization described by the alt-right pipeline.[10][17] Many on the far-right recognize the potential of this radicalization method and actively share right-wing content with the intention of gradually radicalizing those around them. The use of racist imagery or humor may be used by these individuals under the guise of irony or insincerity to make alt-right ideas palpable and acceptable to newer audiences. The nature of internet memes means they can easily be recreated and spread to many different internet communities.[17][18]
YouTube has been identified as a major element in the alt-right pipeline. This is facilitated through an "Alternative Influence Network", in which various right-wing scholars, pundits, and internet personalities interact with one another to boost performance of their content. These figures may vary in their ideologies between conservatism, libertarianism, or white nationalism, but they share a common opposition to feminism, progressivism, and social justice that allows viewers of one figure to quickly acclimate to another.[1] They often prioritize right-wing social issues over right-wing economic issues, with little discussion of fiscal conservatism. Some individuals in this network may not interact with one another, but a collection of interviews, internet debates, and other interactions create pathways for users to be introduced to new content.[2]
YouTube's algorithmic system for recommending videos allows users to quickly access content similar to what they've previously viewed, allowing them to more deeply explore an idea once they've expressed interest. This allows newer audiences to be exposed to extreme content when videos that promote misinformation and conspiracy theories gain traction.[10][7] When a user is exposed to certain content featuring certain political issues or culture war issues, this recommendation system may lead users to different ideas or issues, including Islamophobia, opposition to immigration, antifeminism, or reproduction rates.[10][19] Recommended content is often somewhat related, which creates an effect of gradual radicalization between multiple issues, referred to as a pipeline.[10]
At times, the platform will also recommend these videos to users that had not indicated interest in these viewpoints.[4][19] Radicalization also takes place in interactions with other radicalized users online, on varied platforms such as Gab, Reddit, 4chan, or Discord.[10] Major personalities in this chain often have a presence on Facebook and Twitter, though YouTube is typically their primary platform for messaging and earning income.[7]
The alt-right pipeline mainly targets angry white men, including those who identify as incels, reflecting the misogyny of the alt-right. Harvard Political Review has described this process as the "exploitation of latent misogyny and sexual frustration through 'male bonding' gone horribly awry". The pipeline also targets people with self-doubt.[20]
Content
The alt-right pipeline has been found to begin with the intellectual dark web community, which is made up of internet personalities that are unified by an opposition to identity politics and political correctness, such as Joe Rogan, Ben Shapiro, Dave Rubin, and Jordan Peterson.[2] The intellectual dark web community overlaps and interacts with the alt-lite community, such as Steven Crowder, Paul Joseph Watson, Mark Dice, and Sargon of Akkad.[2] This community in turn overlaps and interacts with the alt-right community, such as James Allsup, Black Pigeon Speaks, Varg Vikernes, and Red Ice.[2] The most extreme endpoint often involves fascism or belief in an international Jewish conspiracy,[17] though the severity of extremism can vary between individuals.[7]
Alt-right content on the internet spreads ideology that is similar to earlier white supremacist and fascist movements. The internet packages the ideology differently, often in a way that is more palatable and thus is more successful in delivering it to a larger number of people.[21] Due to the conservative nature of the alt-right, much of the ideology is associated with the preservation of traditional values and ways of living. This creates a susceptibility toward conspiracy theories about secret forces that seek to destroy traditional ways of life.[22]
The antifeminist Manosphere has been identified as another early point in the alt-right pipeline.[6] The men's rights movement often discusses men's issues more visibly than other groups, attracting young men with interest in such issues when no alternative is made available. Many right-wing internet personalities have developed a method to expand their audiences by commenting on popular media; videos that criticize movies or video games for supporting left-wing ideas are more likely to attract fans of the respective franchises.[7]
The format presented by YouTube has allowed various ideologies to access new audiences through this means.[7] The same process has also been used to facilitate access to anti-capitalist politics through the internet community BreadTube. This community was developed through the use this pipeline process to introduce users to left-wing content and mitigate exposure to right-wing content,[7][11] though the pipeline process has been found to be less effective for left-wing politics due to the larger variety of opposing left-wing groups that limits interaction and overlap.[11] This dichotomy can also cause a "whiplash polarization" in which individuals are converted between far-right and far-left politics.[7]
Psychological factors
The psychological factors of radicalization through the alt-right pipeline are similar to other forms of radicalization, including normalization, acclimation, and dehumanization. Normalization involves the trivialization of racist and antisemitic rhetoric. Individuals early in the alt-right pipeline will not willingly embrace such rhetoric, but will adopt it under the guise of dark humor, causing it to be less shocking over time.[10] This may sometimes be engineered intentionally by members of the alt-right to make their beliefs more palatable and provide plausible deniability for extreme beliefs.[17][18] Acclimation is the process of being conditioned to seeing bigoted content. By acclimating to controversial content, individuals become more open to slightly more extreme content. Over time, conservative figures appear too moderate and users seek out more extreme voices. Dehumanization is the final step of the alt-right pipeline, where minorities are seen as lesser or undeserving of life and dehumanizing language is used to refer to people that disagree with far-right beliefs.[10]
The process is associated with young men that experience loneliness, meaninglessness, or a lack of belonging.[7] An openness to unpopular views is necessary for individuals to accept beliefs associated with the alt-right pipeline. It has been associated with contrarianism, in which an individual uses the working assumption that the worldviews of most people are entirely wrong. From this assumption, individuals are more inclined to adopt beliefs that are unpopular or fringe. This makes effective several entry points of the alt-right pipeline, such as libertarianism, in which ideologies attract individuals with traits that make them susceptible to radicalization when exposed to other fringe ideas.[5] Motivation for pursuing these communities varies, with some people finding them by chance while others seek them out. Interest in video games is associated with the early stages of the alt-right pipeline.[7]
Along with algorithms, online communities can also play a large part in radicalization. People with fringe and radical ideologies can meet other people who share, validate and reinforce those ideologies. Because people can control who and what they engage with online, they can avoid hearing any opinion or idea that conflicts with what their prior beliefs. This creates an echo chamber that upholds and reinforces radical beliefs. The strong sense of community and belonging that comes with it is a large contributing factor for people joining the alt-right and adopting it as an identity.[23]
Concerns and prevention
Internet radicalization correlates with an increase in lone wolf attacks and domestic terrorism.[9][24] The alt-right pipeline has been associated with the Christchurch mosque shootings, in which a far-right extremist killed 51 Muslim worshipers in Christchurch, who directly credited the Internet for the formation of his beliefs in his manifesto.[10][25] The informal nature of radicalization through the alt-right pipeline allows radicalization to occur at an individual level, and radicalized individuals are able to live otherwise normal lives offline. This has complicated efforts by experts to track extremism and predict acts of domestic terrorism, as there is no reliable way of determining who has been radicalized or whether they are planning to carry out political violence.[10][26] Harassment campaigns against perceived opponents of the alt-right movement are another common effect of radicalization.[10]
Many social media platforms have recognized the potential of radicalization and have implemented measures to limit its prevalence. High profile extremist commentators such as Alex Jones have been banned from several platforms, and platforms often have rules against hate speech and misinformation.[7] In 2019, YouTube announced a change to its recommendation algorithm to reduce conspiracy theory related content.[7][19] Some extreme content, such as explicit deceptions of violence, are typically removed on most social media platforms. On YouTube, content that expresses support of extremism may have monetization features removed, may be flagged for review, or may have public user comments disabled.[3]
Studies
A September 2018 study published by the Data & Society Research Institute found that 65 right-wing political influencers use YouTube's recommendation engine—in concert with conventional brand-building techniques such as cross-marketing between similar influencers—to attract followers and radicalize their viewers into a particular right-wing ideology.[27] An August 2019 study conducted by the Universidade Federal de Minas Gerais and École polytechnique fédérale de Lausanne, and presented at the ACM Conference on Fairness, Accountability, and Transparency 2020 used information from the earlier Data & Society research and the Anti-Defamation League (ADL) to categorize the levels of extremism of 360 YouTube channels. The study also tracked users over an 11 year period by analysing 72 million comments, 2 million video recommendations, and 10,000 channel recommendations. The study found that users who engaged with less radical right-wing content tended over time to engage with more extremist content, which the researchers argued provides evidence for a "radicalization pipeline".[2][12][13][14]
A 2020 study published in The International Journal of Press/Politics argued that the "emerging journalistic consensus" that YouTube's algorithm radicalizes users to the far-right "is premature." Instead, the study proposes a "'Supply and Demand' framework for analyzing politics on YouTube."[28]
A 2021 study published in the Proceedings of the National Academy of Sciences found "no evidence that engagement with far-right content is caused by YouTube recommendations systematically, nor do we find clear evidence that anti-woke channels serve as a gateway to the far right." Instead, the study found that "consumption of political content on YouTube appears to reflect individual preferences that extend across the web as a whole."[15] A 2022 study published by the City University of New York found that "little systematic evidence exists to support" the claim that YouTube's algorithm radicalizes users, adding that exposure to extremist views "on YouTube is heavily concentrated among a small group of people with high prior levels of gender and racial resentment.", and that "non-subscribers are rarely recommended videos from alternative and extremist channels and seldom follow such recommendations when offered."[16]
See also
References
- Lewis, Rebecca (18 September 2018). Alternative Influence: Broadcasting the Reactionary Right on YouTube (Report). Data & Society. Archived from the original on 25 May 2022. Retrieved 14 July 2022.
- Ribeiro, Manoel Horta; Ottoni, Raphael; West, Robert; Almeida, Virgílio A. F.; Meira, Wagner (27 January 2020). "Auditing radicalization pathways on YouTube". Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. pp. 131–141. doi:10.1145/3351095.3372879. ISBN 9781450369367. S2CID 201316434.
- Ledwich, Mark; Zaitsev, Anna (26 February 2020). "Algorithmic extremism: Examining YouTube's rabbit hole of radicalization". First Monday. arXiv:1912.11211. doi:10.5210/fm.v25i3.10419. ISSN 1396-0466. S2CID 209460683. Archived from the original on 28 October 2022. Retrieved 28 October 2022.
- Mozilla (7 July 2021). "Mozilla Investigation: YouTube Algorithm Recommends Videos that Violate the Platform's Very Own Policies". Mozilla Foundation. Archived from the original on 25 March 2023. Retrieved 25 March 2023.
- Hermansson, Patrik; Lawrence, David; Mulhall, Joe; Murdoch, Simon (31 January 2020). The International Alt-Right: Fascism for the 21st Century?. Routledge. pp. 57–58. ISBN 978-0-429-62709-5. Archived from the original on 25 July 2023. Retrieved 21 September 2022.
- Mamié, Robin; Horta Ribeiro, Manoel; West, Robert (21 June 2021). "Are Anti-Feminist Communities Gateways to the Far Right? Evidence from Reddit and YouTube". 13th ACM Web Science Conference 2021. WebSci '21. New York, NY, USA: Association for Computing Machinery. pp. 139–147. arXiv:2102.12837. doi:10.1145/3447535.3462504. ISBN 978-1-4503-8330-1. S2CID 232045966. Archived from the original on 25 July 2023. Retrieved 21 September 2022.
- Roose, Kevin (8 June 2019). "The Making of a YouTube Radical". The New York Times. ISSN 0362-4331. Archived from the original on 17 May 2023. Retrieved 26 October 2022.
- Hughes, Terwyn (26 January 2021). "Canada's alt-right pipeline". The Pigeon. Archived from the original on 25 March 2023. Retrieved 25 March 2023.
- Piazza, James A. (2 January 2022). "Fake news: the effects of social media disinformation on domestic terrorism". Dynamics of Asymmetric Conflict. 15 (1): 55–77. doi:10.1080/17467586.2021.1895263. ISSN 1746-7586. S2CID 233679934. Archived from the original on 25 July 2023. Retrieved 4 November 2022.
- Munn, Luke (1 June 2019). "Alt-right pipeline: Individual journeys to extremism online". First Monday. doi:10.5210/fm.v24i6.10108. ISSN 1396-0466. S2CID 184483249. Archived from the original on 24 May 2022. Retrieved 14 July 2022.
- Cotter, Kelley (18 March 2022). "Practical knowledge of algorithms: The case of BreadTube". New Media & Society. doi:10.1177/14614448221081802. ISSN 1461-4448. S2CID 247560346.
- Lomas, Natasha (28 January 2020). "Study of YouTube comments finds evidence of radicalization effect". TechCrunch. Retrieved 17 July 2021.
- Newton, Casey (28 August 2019). "YouTube may push users to more radical views over time, a new paper argues". The Verge. Retrieved 17 July 2021.
- Ribeiro, Manoel Horta; Ottoni, Raphael; West, Robert; Almeida, Virgílio A. F.; Meira, Wagner (22 August 2019). "Auditing Radicalization Pathways on YouTube". arXiv:1908.08313 [cs.CY].
- Hosseinmardi, Homa; Ghasemian, Amir; Clauset, Aaron; Mobius, Markus; Rothschild, David M.; Watts, Duncan J. (2 August 2021). "Examining the consumption of radical content on You Tube". Proceedings of the National Academy of Sciences. 118 (32). arXiv:2011.12843. Bibcode:2021PNAS..11801967H. doi:10.1073/pnas.2101967118. PMC 8364190. PMID 34341121.
-
- Chen, Annie Y.; Nyhan, Brendan; Reifler, Jason; Robertson, Ronald E.; Wilson, Christo (22 April 2022). "Subscriptions and external links help drive resentful users to alternative and extremist YouTube videos". arXiv:2204.10921 [cs.SI].
- Wolfe, Liz (26 April 2022). "YouTube Algorithms Don't Turn Unsuspecting Masses Into Extremists, New Study Suggests / A new study casts doubt on the most prominent theories about extremism-by-algorithm". Reason. Archived from the original on 26 April 2022.
- Evans, Robert (11 October 2018). "From Memes to Infowars: How 75 Fascist Activists Were "Red-Pilled"". Bellingcat. Archived from the original on 21 November 2018. Retrieved 27 October 2022.
- Wilson, Jason (23 May 2017). "Hiding in plain sight: how the 'alt-right' is weaponizing irony to spread fascism". The Guardian. Archived from the original on 28 October 2022. Retrieved 28 October 2022.
- Bennhold, Katrin; Fisher, Max (7 September 2018). "As Germans Seek News, YouTube Delivers Far-Right Tirades". The New York Times. Archived from the original on 14 March 2023. Retrieved 25 March 2023.
- Scully, Aidan (10 October 2021). "The Dangerous Subtlety of the Alt-Right Pipeline". Harvard Political Review. Retrieved 27 July 2023.
- Daniels, Jessie (2018). "The Algorithmic Rise of the "Alt-Right"". Contexts. 17 (1): 60–65. doi:10.1177/1536504218766547. ISSN 1536-5042. S2CID 196005328. Archived from the original on 2 October 2022. Retrieved 7 May 2023.
- Wilson, Andrew (16 February 2018). "#whitegenocide, the Alt-right and Conspiracy Theory: How Secrecy and Suspicion Contributed to the Mainstreaming of Hate". Secrecy and Society. 1 (2). doi:10.31979/2377-6188.2018.010201. ISSN 2377-6188. Archived from the original on 30 May 2023. Retrieved 7 May 2023.
- Alfano, Mark; Carter, J. Adam; Cheong, Marc (2018). "Technological Seduction and Self-Radicalization". Journal of the American Philosophical Association. 4 (3): 298–322. doi:10.1017/apa.2018.27. ISSN 2053-4477. S2CID 150119516. Archived from the original on 12 December 2022. Retrieved 7 May 2023.
- Hunter, Lance Y.; Griffith, Candace E.; Warren, Thomas (3 May 2020). "Internet connectivity and domestic terrorism in democracies". International Journal of Sociology. 50 (3): 201–219. doi:10.1080/00207659.2020.1757297. ISSN 0020-7659. S2CID 219059064. Archived from the original on 25 July 2023. Retrieved 4 November 2022.
- Veilleux-Lepage, Yannick; Daymon, Chelsea; Amarasingam, Amarnath (2020). The Christchurch attack report: key takeaways on tarrant's radicalization and attack planning (PDF) (Report). International Centre for Counter-Terrorism. Archived from the original (PDF) on 4 November 2022. Retrieved 4 November 2022.
- Mølmen, Guri Nordtorp; Ravndal, Jacob Aasland (30 October 2021). "Mechanisms of online radicalisation: how the internet affects the radicalisation of extreme-right lone actor terrorists". Behavioral Sciences of Terrorism and Political Aggression. 15 (4): 463–487. doi:10.1080/19434472.2021.1993302. hdl:10852/93317. ISSN 1943-4472. S2CID 240343107.
- Ingram, Mathew (19 September 2018). "YouTube's secret life as an engine for right-wing radicalization". Columbia Journalism Review. Archived from the original on 23 September 2018.
- Munger, Kevin; Phillips, Joseph (2020). "Right-Wing YouTube: A Supply and Demand Perspective". The International Journal of Press/Politics. 27 (1): 186–219. doi:10.1177/1940161220964767. ISSN 1940-1612. S2CID 226339609. Archived from the original on 13 October 2022. Retrieved 28 October 2022.