Send the following on WhatsApp
Continue to ChatQuery : Grapeshot crawler ignoring robots.txt Has anyone come across a crawler called Grapeshot? They are hammering the same page repeatedly on our website. I believe they are looking for ad related keywords, https://vmapp.org/query/105620/Grapeshot-Crawler-Ignoring-Robots-Txt-Has-Anyone-Come-Across-A-Crawler-Called-Grapeshot-They-Are-Hammering-The-Same-Page-Repeatedly-On-Our-Website-I-Believe-They-Are-Looking-For-Ad-Related-Keywords/