RetroLemmy
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
ItWasntMe@discuss.online to Fuck AI@lemmy.worldEnglish · 2 months ago

Aggressive AI scrapers are making it kinda suck to run wikis

weirdgloop.org

external-link
message-square
41
link
fedilink
  • cross-posted to:
  • selfhosting@slrpnk.net
  • technology@lemmy.zip
  • technology@beehaw.org
  • technology@lemmy.world
  • pulse_of_truth@infosec.pub
  • lobsters@lemmy.bestiver.se
167
external-link

Aggressive AI scrapers are making it kinda suck to run wikis

weirdgloop.org

ItWasntMe@discuss.online to Fuck AI@lemmy.worldEnglish · 2 months ago
message-square
41
link
fedilink
  • cross-posted to:
  • selfhosting@slrpnk.net
  • technology@lemmy.zip
  • technology@beehaw.org
  • technology@lemmy.world
  • pulse_of_truth@infosec.pub
  • lobsters@lemmy.bestiver.se
Bots are currently scraping the internet for LLM training data at unprecedented rates[1][2][3], driving up costs and destabilizing public-facing websites. I want to talk about how this has been particularly difficult for wikis, and has gotten much worse in the last few months.
  • Maroon@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    1 month ago

    deleted by creator

    • ElectricVocalist@jlai.lu
      link
      fedilink
      arrow-up
      1
      ·
      1 month ago

      Crawlers have never been a problem for me as my internet subscription is unlimited. My experience comes from being the one crawling sites and bypassing the CF challenge

Fuck AI@lemmy.world

fuck_ai@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !fuck_ai@lemmy.world

“We did it, Patrick! We made a technological breakthrough!”

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as “AI” meant to increase market valuations.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 821 users / day
  • 3.63K users / week
  • 7.92K users / month
  • 17.2K users / 6 months
  • 9 local subscribers
  • 7.56K subscribers
  • 3.42K Posts
  • 47.8K Comments
  • Modlog
  • mods:
  • Proud Cascadian@lemmy.world
  • MrMcGasion@lemmy.world
  • TootSweet@lemmy.world
  • BigMikeInAustin@lemmy.world
  • cynar@lemmy.world
  • drmeanfeel@lemmy.world
  • pavnilschanda@lemmy.world
  • CriticalMedicine@lemmy.world
  • WonderfulWanderer@lemmy.world
  • Communist@lemmy.ml
  • eatCasserole@lemmy.world
  • SpaceNoodle@lemmy.world
  • NutWrench@lemmy.world
  • Soup@lemmy.cafe
  • Avicenna@lemmy.world
  • Tinks@lemmy.world
  • wizblizz@lemmy.world
  • corus_kt@lemmy.world
  • Prandom_returns@lemm.eedeleted by creator
  • TrickDacy@lemmy.world
  • TheFriar@lemm.ee
  • Queen HawlSera@lemm.ee
  • andrew_bidlaw@sh.itjust.works
  • MeDuViNoX@sh.itjust.works
  • 33550336@lemmy.world
  • Nougat@fedia.io
  • Lost_My_Mind@lemmy.world
  • The D Quuuuuill@slrpnk.net
  • scratsearcher 🔍🔮📊🎲@sopuli.xyz
  • e8d79@discuss.tchncs.de
  • ThefuzzyFurryComrade@pawb.social
  • BE: 0.19.19
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org