Finchbot is the web crawler used by Finchling - our platform that tracks news, government regulations and online content to alert brands about events that could affect them. Finchbot helps us discover and analyse public web content that might be of interest to brand, PR & comms teams at consumer brands.
We aim to be transparent and respectful in how we operate. Finchbot only accesses publicly available pages and obeys the directives set in your site's robots.txt.
How to control Finchbot's access
If you'd prefer Finchbot not to crawl your site, you can block it by adding the following lines to your robots.txt file:
User-agent: Finchbot
Disallow: /Technical details
User-Agent: Finchbot
Purpose: Discover and analyse news and web content for brand intelligence
Crawl behaviour: Respects robots.txt
If you have questions or believe Finchbot is accessing your site in error, you can contact us at [email protected]