On a separate thread - want to say that I don't think pay-per-crawl (a la Cloudflare) is a viable model. I think a better approach is to go via the usual licensing contracts. See my blog post: https://developerwithacat.com/blog/202507/cloudflare-pay-per... and an example with OpenAI / Reddit: https://openai.com/index/openai-and-reddit-partnership/

This is a good project. The problem with things like AI is that if they can just copy the content and the original creators stop making money, they go out of business. Then who's creating the original content?

Used title from FT paywalled article https://www.ft.com/content/2622f8d7-9564-434c-bae6-a0c4c254b... as it's more meaningful