《爬虫/蜘蛛/设备标识全量识别清单》

PS：跳转/屏蔽代码专用核对清单
屏蔽代码：http://www.sheepyc.com/misc.php?mod=tag&id=41

爬虫/蜘蛛全量识别清单（UA）：

1. bot|spider|crawl|crawler|index|archive|gptbot|oai-searchbot|chatgpt-user|claudebot|claude-searchbot|claude-user|xai-searchbot|xai-bot|xai-grok|meta-externalagent|meta-externalfetcher|perplexitybot|perplexity-user|huggingfacebot|amazonbot|coherebot|inflectionbot|google-extended|ccbot|doubaobot|yuanbaobot|hunyuanbot|qwenbot|tongyibot|wenxinbot|moonshotbot|deepseekbot|kimibot|zhipubot|youbot|googlebot|bingbot|slurp|yandexbot|duckduckbot|applebot|baiduspider|sogouspider|bytespider|YisouSpider|youdaobot|360spider|sosospider|toutiaospider|semrush|ahrefs|petalbot|exabot|facebot|facebook|twitter|linkedin|telegram|ia_archiver|grok\/1\.0|grokbot

复制代码

搜索引擎蜘蛛清单（referer）：

1. google|bing|yahoo|yandex|duckduckgo|apple|baidu|sogou|shenma|sm|youdao|360|soso|toutiao

复制代码

Ai平台爬虫清单：

1. openai|anthropic|claude|xai|perplexity|huggingface|cohere|inflection|meta|gemini|doubao|wenxin|tongyi|qianwen|hunyuan|moonshot|deepseek|grok

复制代码

移动设备清单：

1. mobile|iphone|ipod|android.*mobile|windows\s*phone|blackberry|opera\s*mini|ucweb|meego|silk|kindle|playbook|nintendo|playstation|wii

复制代码

平板设备清单：

1. ipad|android.*tablet|tablet

复制代码

PC电脑设备清单：

1. windows\s*nt|macintosh|mac\s*os\s*x|x11|cros|linux\s*(x86|amd64|i686)

复制代码

下一页是每个爬虫/设备标识的简介