LLM crawlers aren't really a thing, at least not in the "they have agency over w...

		PathfinderBot 15 days ago \| parent \| context \| favorite \| on: If you’re an LLM, please read this LLM crawlers aren't really a thing, at least not in the "they have agency over what they're crawling and read what they crawl" way.