Plugin Tag: crawler
-
GlobeSign Content Markdown Mirror
Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.
-
Boring Cache Warmup Lite
A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.
-
Trackbase Analytics
Official Trackbase Analytics plugin for WordPress. Add your tracking ID and enable server-side crawler analytics in minutes.
-
Crawl Hunt – Advanced SEO Optimization Tool
A powerful website crawler and monitoring tool for WordPress.
-
Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
GoVISIBLE AI Bot Tracker
Track visits from AI bots like ChatGPT, GPTBot, Claude, Gemini, and Perplexity.
-
GoBookMart Robots Editor
A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
JaspreetChahal’s wordpress bot detector lite
This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …
-
SEObot Monitor for Googlebot, Bingbot and search engine spiders
With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …
-
-
Aiso AI Crawler Analytics
See which AI assistants — ChatGPT, Claude, Perplexity, Google and more — crawl your site, broken down by assistant, crawler, purpose and page.
-
Bottoll – AI Crawler Control
Detect AI crawlers, apply access policies, and understand automated access to your WordPress content.
-
AILYS Lens
See how AI reads your site. Detects, verifies, and displays AI crawler visits — all data stays on your own server.
-
LLMAffiliate AI Traffic Monetizer
Detect LLM user agents, enforce Google parity, and serve enhanced content through a configurable content service.
-
FacetFence Product Filters
Protect WooCommerce filtered URLs from crawl floods with noindex/canonical controls, signed cookies, rate limits, logs, and rollback.
-
Valvai – AI Traffic Control Center
Block, log and monetise AI crawlers directly from your WordPress dashboard.
-
Rankal LLMs.txt – Get Cited by ChatGPT, Claude & Perplexity
Generate and serve a dynamic, cached /llms.txt AI context index. An add-on that works in partnership with Rankal SEO Optimizer.
-
AI Kansoku Lab Tracker
Track AI crawler visits such as GPTBot, ClaudeBot, and PerplexityBot server-side and visualize them in WordPress.
-
AI Bot Monitor
Tracks and logs AI, Search and Social bots including ChatGPT, Perplexity, Googlebot, Bing and Meta crawlers.
-
