Gaming platform to use facial age estimation to limit chats to similar age groups, as allegations of grooming grow

From next month it will start enforcing facial age estimation to allow children to chat with strangers only if they are in their broad age group.

Roblox compared its new system to school cohorts such as elementary, middle school and high school. It will be introduced first in Australia, New Zealand and the Netherlands, where children will be blocked from privately chatting with adults they do not know in real life from next month, and in the rest of the world in early January.

Users will be placed into the following groups: under nine, nine to 12, 13 to 15, 16 to 17, 18 to 20, or 21 and over. Children will be able to chat only with others in their age group and similar ones. For example, a child with an estimated age of 12 will be able to chat only with under-16s. Images and video used for the checks would not be stored, Roblox said.

  • rtxn@lemmy.worldEnglish
    411·
    6 hours ago

    Problem: the game is getting a notoriety for being infested by pedophiles and the developers are actively protecting them.

    Solution: send your photographs to the game infested by pedophiles to prove you are a real child!

    Fucking. Incredible. If this was written in a manuscript, it would be tossed for being too cartoonishly unrealistic.

      • rtxn@lemmy.worldEnglish
        7·
        2 hours ago

        Absolutely! Multiple, in fact. In order of preference:

        1. Shut down the game, dissolve the company, and donate all remaining funds to a women’s shelter.
        2. Prosecute groomers instead of banning and threatening the people who are trying to stop the fuckers and crying about vigilantism even when the proper reporting channels are used.
        3. Use AI for a beneficial purpose at least one goddamn time. Scan the text and voice communications (it’s a public game, there is no expectation of privacy), flag suspicious exchanges for human review, then ban and report groomers.
        • Naho_Zako@piefed.zipEnglish
          2·
          23 minutes ago

          Honestly, getting rid of any chat (voice/text) and DM features would would help. I don’t think kids should completely lose online gaming, just make it almost impossible to communicate with anyone on said game. I played a shit ton of Mario Kart and Splatoon online as a kid, but neither of those games offer personal messages/chat features (unless you set them up via app), so I imagine grooming would be almost impossible.

          I don’t want to take Roblox away from kids, as I understand how fun it was growing up, especially if you can’t afford a console/games at home. But chat has to be either heavily moderated, or just entirely removed imo.

      • altkey (he\him)@lemmy.dbzer0.comEnglish
        4·
        2 hours ago

        Them having an office large enough to moderate in-game communications, on every popular language? They have some billions to spare. Serving kids requires a lot of work they have neglected for a very long time.

        Facebook was a vehicle for hateful, genocidal messages in Myanmar, and they seemingly got of the hook having no person understanding local language on the market they occupied.

        If Roblox primarily targets kids, they can’t go without agressive moderation, psy-help on demand, things one would find obvious, but these are never required, not to say it’s not that sexy as getting profits and cutting corners.

        I don’t know if their business model would be viable if they started things right from the beginning, but it would be more stressful to them to finally start doing something about that.