• Kichae@lemmy.ca
    link
    fedilink
    English
    arrow-up
    5
    ·
    2 months ago

    No, then you have many compounding and interacting variables. Maybe it’s free snacks that improve mental health. Maybe it’s the features of the room. Maybe it’s specific adventures.

    Even with large numbers, experiments need some controls. You either need to know the context details so you can account for them, or ensure they’re the same across all observations.

    • TOModera@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      2 months ago

      Good points. Could you control for those factors? Granted thr room features one would be hard to do in an inexpensive way, so third parties may not be the option. Food for thought, thank you.

      • Kichae@lemmy.ca
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 months ago

        With a large enough test, you could provide several adventures, several systems even (there’s zero reason to make the claim specifically about one commercial product when TTRPGs are a whole hobby category), with or without snacks, in a controlled environment, with a set roster of GMs. It would just take many thousands of participants over years to run the study.