Tea@programming.dev to Technology@lemmy.worldEnglish · edit-210 days agoAI crawlers cause Wikimedia(The umbrella organization of Wikipedia and a dozen or so other crowdsourced knowledge projects) Commons bandwidth demands to surge 50%.diff.wikimedia.orgexternal-linkmessage-square77fedilinkarrow-up11arrow-down10cross-posted to: technology@beehaw.org
arrow-up11arrow-down1external-linkAI crawlers cause Wikimedia(The umbrella organization of Wikipedia and a dozen or so other crowdsourced knowledge projects) Commons bandwidth demands to surge 50%.diff.wikimedia.orgTea@programming.dev to Technology@lemmy.worldEnglish · edit-210 days agomessage-square77fedilinkcross-posted to: technology@beehaw.org
minus-squareStrawberry@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up0·8 days agoSure but we’re in the comments section of an article about wikipedia being crawled, which is silly because they could just download a snapshot of wikipedia
Sure but we’re in the comments section of an article about wikipedia being crawled, which is silly because they could just download a snapshot of wikipedia