Looks openai added the ability to block their website scraping bot. Using robots.txt

https://platform.openai.com/docs/gptbot Looks openai added the ability to block their website scraping bot. Using robots.txt