Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Added comments count endpoint to robots.txt disallow list
fix https://linear.app/tryghost/issue/ENG-771/add-comments-count-endpoint-to-robotstxt-ignorelist - we've seen web scrapers hitting this endpoint a lot, but the value to be taken from it is minimal for SEO purposes - adding it to robots.txt should encourage web scrapers to ignore it, and we should see less traffic as a result
- Loading branch information