In the olden days of the WWW you could just put a robots.txt file in the root of your website and crawling bots from search engines and kin would (generally) respect the rules in it. These days, ho…
  • xoggy@programming.dev
    0·
    6 days ago

    Generate endless markov nonsense for LLM crawlers to choke on. Basically the young kids (LLMs) being forced to listen to grandpa Markov’s senile babbling over an excruciatingly slow dinner…