搜索[Bing],共找到3个文章
禁止PC和移动直接访问,只能通过搜索打开且 不影响蜘蛛抓取
RewriteEngine On # 检查User-Agent是否为搜索引擎 RewriteCond %{HTTP_USER_AGENT} (Googlebot|Bingbot|Baiduspider) [NC] RewriteRule ^ - [L] # 重定向所有直接访问请求到搜索引擎 RewriteCo...
nginx 屏蔽网站首页访问 允许蜘蛛访问的方法
location = / { if ($http_user_agent !~* (spider|bot|googlebot|bingbot|yandex|msnbot|slurp)) { return 403; } # other rules }