Game On, Hate Off

A Study of Toxicity in Online Multiplayer Environments

Zachary YangNicolas Grenen-GodboutRaihaneh Rabbany

August 12, 2024,

The advent of online spaces, particularly social media platforms and video games, has brought forth a significant challenge: the detection and mitigation of toxic and harmful speech. This issue is not only pervasive but also detrimental to the overall user experience. In this study, we leverage small language models to reliably detect toxicity, achieving an average precision of 0.95. Analyzing eight months of chat data from two Ubisoft games, we uncover patterns and trends in toxic behavior. The insights derived from our research will con- tribute to the development of healthier online communities and inform preventive measures against toxicity.

Nicolas Grenen-Godbout

Nicolas Grenen-Godbout

Data scientist with a strong background in statistics, machine learning and algorithmics. Passionate about educating and empowering colleagues from all horizons, and am always looking for opportunities to exchange knowledge and experience in that ever changing field. Leading a team of data scientists within the Ubisoft Data Office.

Raihaneh Rabbany

Raihaneh Rabbany

With my group, at Complex Data Lab, we work on designing methods for analyzing such data; building on techniques for graph mining, graph representation learning, unsupervised and self-supervised learning, anomaly detection, learning with weak and/or uncertain labels, and active and human-in-the-loop learning.

Share this story. Choose your platform.

Want more updates and information from ACM? Sign up for our Newsletter.

Related Articles

  • An Empirical Study of VR Head-Mounted Displays Based on VR Games Reviews

    In recent years, the VR tech boom has signaled fruitful applications in various fields.

    Yijun LuKaoru OtaMianxiong Dong

    August 22, 2024,

  • A lighthouse illuminates the water against a sunset background.

    Inaugural Editorial: A Lighthouse for Games and Playable Media

    Helping readers to find their way in this new, ever-shifting reality of games industry and research.

    Sebastian DeterdingKenny MitchellBrad KingRachel Kowert

    March 13, 2023,

  • A hand holds a smartphone showing Pokemon GO game in a supermarket aisle.

    Pokémon GO as an Advertising Platform

    This article explores a notable gap in the literature on locative media: the impacts of LBA on small businesses in the location-based game Pokémon GO.

    John DunhamJiangnan XuKonstantinos PapangelisNicolas LaloneMichael SakerDavid Schwartz

    August 11, 2024,

  • Adventures in Avoiding DAIS Buffers

    After watching Horizon Forbidden West’s presentation on their usage of visibility buffers, it became apparent my approach was suboptimal.

    Baktash Abdollah-Shamshir-saz

    August 16, 2024,