做網(wǎng)站seo的人都知道蜘蛛爬蟲(chóng)這個(gè)詞,每個(gè)搜索引擎都有自己的蜘蛛,蜘蛛的作用就是爬取各個(gè)網(wǎng)站的網(wǎng)頁(yè)從而收錄到自己的數(shù)據(jù)庫(kù)中供用戶(hù)搜索,蜘蛛在爬取網(wǎng)站的時(shí)候網(wǎng)站服務(wù)器的壓力也會(huì)增大,如果細(xì)心的站長(zhǎng)就會(huì)從網(wǎng)站日記分析各個(gè)搜索引擎蜘蛛爬蟲(chóng)的記錄,有時(shí)候會(huì)發(fā)現(xiàn)有很多ip都在爬取網(wǎng)頁(yè),有的可能就是假蜘蛛,只要知道官方蜘蛛的IP就可以屏蔽這些假蜘蛛了。
360搜索引擎蜘蛛IP
42.236.99.2 42.236.99.3 42.236.99.4 42.236.99.5 42.236.99.6 42.236.99.7 42.236.99.8 42.236.99.9 42.236.99.10 42.236.99.11 42.236.99.12 42.236.99.13 42.236.99.14 42.236.99.15 42.236.99.16 42.236.99.17 42.236.99.18 42.236.99.19 42.236.99.20 42.236.99.21 42.236.99.22 42.236.99.23 42.236.99.24 42.236.99.25 42.236.99.26 42.236.99.27 42.236.99.28 42.236.99.29 42.236.99.30 42.236.99.31 42.236.99.32 42.236.99.33 42.236.99.34 42.236.99.35 42.236.99.36 42.236.99.37 42.236.99.38 42.236.99.39 42.236.99.40 42.236.99.41 42.236.99.42 42.236.99.43 42.236.99.44 42.236.99.45 42.236.99.46 42.236.99.47 42.236.99.48 42.236.99.49 42.236.99.50 42.236.99.51 42.236.99.52 42.236.99.53 42.236.99.54 42.236.99.55 42.236.99.56 42.236.99.57 42.236.99.58 42.236.99.59 42.236.99.60 42.236.99.61 42.236.99.62 42.236.99.63 42.236.99.64 42.236.99.65 42.236.99.66 42.236.99.67 42.236.99.68 42.236.99.69 42.236.99.70 42.236.99.71 42.236.99.72 42.236.99.73 42.236.99.74 42.236.99.75 42.236.99.76 42.236.99.77 42.236.99.78 42.236.99.79 42.236.99.80 42.236.99.81 42.236.99.82 42.236.99.83 42.236.99.84 42.236.99.85 42.236.99.86 42.236.99.87 42.236.99.88 42.236.99.89 42.236.99.90 42.236.99.91 42.236.99.92 42.236.99.93 42.236.99.94 42.236.99.95 42.236.99.96 42.236.99.97 42.236.99.98 42.236.99.99 42.236.99.100 42.236.99.101 42.236.99.102 42.236.99.103 42.236.99.104 42.236.99.105 42.236.99.106 42.236.99.107 42.236.99.108 42.236.99.109 42.236.99.110 42.236.99.111 42.236.99.112 42.236.99.113 42.236.99.114 42.236.99.115 42.236.99.116 42.236.99.117 42.236.99.118 42.236.99.119 42.236.99.120 42.236.99.121 42.236.99.122 42.236.99.123 42.236.99.124 42.236.99.125 42.236.99.126 42.236.12.130 42.236.12.131 42.236.12.132 42.236.12.133 42.236.12.134 42.236.12.135 42.236.12.136 42.236.12.137 42.236.12.138 42.236.12.139 42.236.12.140 42.236.12.141 42.236.12.142 42.236.12.143 42.236.12.144 42.236.12.145 42.236.12.146 42.236.12.147 42.236.12.148 42.236.12.149 42.236.12.150 42.236.12.151 42.236.12.152 42.236.12.153 42.236.12.154 42.236.12.155 42.236.12.156 42.236.12.157 42.236.12.158 42.236.12.159 42.236.12.160 42.236.12.161 42.236.12.162 42.236.12.163 42.236.12.164 42.236.12.165 42.236.12.166 42.236.12.167 42.236.12.168 42.236.12.169 42.236.12.170 42.236.12.171 42.236.12.172 42.236.12.173 42.236.12.174 42.236.12.175 42.236.12.176 42.236.12.177 42.236.12.178 42.236.12.179 42.236.12.180 42.236.12.181 42.236.12.182 42.236.12.183 42.236.12.184 42.236.12.185 42.236.12.186 42.236.12.187 42.236.12.188 42.236.12.189 42.236.12.190 42.236.46.66 42.236.46.67 42.236.46.68 42.236.46.69 42.236.46.70 42.236.46.71 42.236.46.72 42.236.46.73 42.236.46.74 42.236.46.75 42.236.46.76 42.236.46.77 42.236.46.78 42.236.46.79 42.236.46.80 42.236.46.81 42.236.46.82 42.236.46.83 42.236.46.84 42.236.46.85 42.236.46.86 42.236.46.87 42.236.46.88 42.236.46.89 42.236.46.90 42.236.46.91 42.236.46.92 42.236.46.93 42.236.46.94 42.236.46.95 42.236.46.96 42.236.46.97 42.236.46.98 42.236.46.99 42.236.46.100 42.236.46.101 42.236.46.102 42.236.46.103 42.236.46.104 42.236.46.105 42.236.46.106 42.236.46.107 42.236.46.108 42.236.46.109 42.236.46.110 42.236.46.111 42.236.46.112 42.236.46.113 42.236.46.114 42.236.46.115 42.236.46.116 42.236.46.117 42.236.46.118 42.236.46.119 42.236.46.120 42.236.46.121 42.236.46.122 42.236.46.123 42.236.46.124 42.236.54.2 42.236.54.3 42.236.54.4 42.236.54.5 42.236.54.6 42.236.54.7 42.236.54.8 42.236.54.9 42.236.54.10 42.236.54.11 42.236.54.12 42.236.54.13 42.236.54.14 42.236.54.15 42.236.54.16 42.236.54.17 42.236.54.18 42.236.54.19 42.236.54.20 42.236.54.21 42.236.54.22 42.236.54.23 42.236.54.24 42.236.54.25 42.236.54.26 42.236.54.27 42.236.54.28 42.236.54.29 42.236.54.30 42.236.54.31 42.236.54.32 42.236.54.33 42.236.54.34 42.236.54.35 42.236.54.36 42.236.54.37 42.236.54.38 42.236.54.39 42.236.54.40 42.236.54.41 42.236.54.42 42.236.54.43 42.236.54.44 42.236.54.45 42.236.54.46 42.236.54.47 42.236.54.48 42.236.54.49 42.236.54.50 42.236.54.51 42.236.54.52 42.236.54.53 42.236.54.54 42.236.54.55 42.236.54.56 42.236.54.57 42.236.54.58 42.236.54.59 42.236.54.60 42.236.54.61 42.236.54.62 42.236.55.2 42.236.55.3 42.236.55.4 42.236.55.5 42.236.55.6 42.236.55.7 42.236.55.8 42.236.55.9 42.236.55.10 42.236.55.11 42.236.55.12 42.236.55.13 42.236.55.14 42.236.55.15 42.236.55.16 42.236.55.17 42.236.55.18 42.236.55.19 42.236.55.20 42.236.55.21 42.236.55.22 42.236.55.23 42.236.55.24 42.236.55.25 42.236.55.26 42.236.55.27 42.236.55.28 42.236.55.29 42.236.55.30 42.236.55.31 42.236.55.32 42.236.55.33 42.236.55.34 42.236.55.35 42.236.55.36 42.236.55.37 42.236.55.38 42.236.55.39 42.236.55.40 42.236.55.41 42.236.55.42 42.236.55.43 42.236.55.44 42.236.55.45 42.236.55.46 42.236.55.47 42.236.55.48 42.236.55.49 42.236.55.50 42.236.55.51 42.236.55.52 42.236.55.53 42.236.55.54 42.236.55.55 42.236.55.56 42.236.55.57 42.236.55.58 42.236.55.59 42.236.55.60 42.236.101.194 42.236.101.195 42.236.101.196 42.236.101.197 42.236.101.198 42.236.101.199 42.236.101.200 42.236.101.201 42.236.101.202 42.236.101.203 42.236.101.204 42.236.101.205 42.236.101.206 42.236.101.207 42.236.101.208 42.236.101.209 42.236.101.210 42.236.101.211 42.236.101.212 42.236.101.213 42.236.101.214 42.236.101.215 42.236.101.216 42.236.101.217 42.236.101.218 42.236.101.219 42.236.101.220 42.236.101.221 42.236.101.222 42.236.101.223 42.236.101.224 42.236.101.225 42.236.101.226 42.236.101.227 42.236.101.228 42.236.101.229 42.236.101.230 42.236.101.231 42.236.101.232 42.236.101.233 42.236.101.234 42.236.101.235 42.236.101.236 42.236.101.237 42.236.101.238 42.236.101.239 42.236.101.240 42.236.101.241 42.236.101.242 42.236.101.243 42.236.101.244 42.236.101.245 42.236.101.246 42.236.101.247 42.236.101.248 42.236.101.249 42.236.101.250 42.236.101.251 42.236.101.252 42.236.102.2 42.236.102.3 42.236.102.4 42.236.102.5 42.236.102.6 42.236.102.7 42.236.102.8 42.236.102.9 42.236.102.10 42.236.102.11 42.236.102.12 42.236.102.13 42.236.102.14 42.236.102.15 42.236.102.16 42.236.102.17 42.236.102.18 42.236.102.19 42.236.102.20 42.236.102.21 42.236.102.22 42.236.102.23 42.236.102.24 42.236.102.25 42.236.102.26 42.236.102.27 42.236.102.28 42.236.102.29 42.236.102.30 42.236.102.31 42.236.102.32 42.236.102.33 42.236.102.34 42.236.102.35 42.236.102.36 42.236.102.37 42.236.102.38 42.236.102.39 42.236.102.40 42.236.102.41 42.236.102.42 42.236.103.66 42.236.103.67 42.236.103.68 42.236.103.69 42.236.103.70 42.236.103.71 42.236.103.72 42.236.103.73 42.236.103.74 42.236.103.75 42.236.103.76 42.236.103.77 42.236.103.78 42.236.103.79 42.236.103.80 42.236.103.81 42.236.103.82 42.236.103.83 42.236.103.84 42.236.103.85 42.236.103.86 42.236.103.87 42.236.103.88 42.236.103.89 42.236.103.90 42.236.103.91 42.236.103.92 42.236.103.93 42.236.103.94 42.236.103.95 42.236.103.96 42.236.103.97 42.236.103.98 42.236.103.99 42.236.103.100 42.236.103.101 42.236.103.102 42.236.103.103 42.236.103.104 42.236.103.105 42.236.103.106 42.236.103.107 42.236.103.108 42.236.103.109 42.236.103.110 42.236.103.111 42.236.103.112 42.236.103.113 42.236.103.114 42.236.103.115 42.236.103.116 42.236.103.117 42.236.103.118 42.236.103.119 42.236.103.120 42.236.103.121 42.236.103.122 42.236.103.123 42.236.103.124 42.236.103.125 42.236.99.130 42.236.99.131 42.236.99.132 42.236.99.133 42.236.99.134 42.236.99.135 42.236.99.136 42.236.99.137 42.236.99.138 42.236.99.139 42.236.99.140 42.236.99.141 42.236.99.142 42.236.99.143 42.236.99.144 42.236.99.145 42.236.99.146 42.236.99.147 42.236.99.148 42.236.99.149 42.236.99.150 42.236.99.151 42.236.99.152 42.236.99.153 42.236.99.154 42.236.99.155 42.236.99.156 42.236.99.157 42.236.99.158 42.236.99.159 42.236.99.160 42.236.99.161 42.236.99.162 42.236.99.163 42.236.99.164 42.236.99.165 42.236.99.166 42.236.99.167 42.236.99.168 42.236.99.169 42.236.99.170 42.236.99.171 42.236.99.172 42.236.99.173 42.236.99.174 42.236.99.175 42.236.99.176 42.236.99.177 42.236.99.178 42.236.99.179 42.236.99.180 42.236.99.181 42.236.99.182 42.236.99.183 42.236.99.184 42.236.99.185 42.236.99.186 42.236.99.187 42.236.99.188 42.236.99.189 42.236.99.190 42.236.99.194 42.236.99.195 42.236.99.196 42.236.99.197 42.236.99.198 42.236.99.199 42.236.99.200 42.236.99.201 42.236.99.202 42.236.99.203 42.236.99.204 42.236.99.205 42.236.99.206 42.236.99.207 42.236.99.208 42.236.99.209 42.236.99.210 42.236.99.211 42.236.99.212 42.236.99.213 42.236.99.214 42.236.99.215 42.236.99.216 42.236.99.217 42.236.99.218 42.236.99.219 42.236.99.220 42.236.99.221 42.236.99.222 42.236.99.223 42.236.99.224 42.236.99.225 42.236.99.226 42.236.99.227 42.236.99.228 42.236.99.229 42.236.99.230 42.236.99.231 42.236.99.232 42.236.99.233 42.236.99.234 42.236.99.235 42.236.99.236 42.236.99.237 42.236.99.238 42.236.99.239 42.236.99.240 42.236.99.241 42.236.99.242 42.236.99.243 42.236.99.244 42.236.99.245 42.236.99.246 42.236.99.247 42.236.99.248 42.236.99.249 42.236.99.250 42.236.99.251 42.236.99.252 42.236.99.253 42.236.99.254 180.153.236.11 180.153.236.12 180.153.236.13 180.153.236.14 180.153.236.15 180.153.236.16 180.153.236.17 180.153.236.18 180.153.236.19 180.153.236.20 180.153.236.21 180.153.236.22 180.153.236.23 180.153.236.24 180.153.236.25 180.153.236.26 80.153.236.35 80.153.236.36 80.153.236.37 80.153.236.38 80.153.236.39 80.153.236.40 80.153.236.41 80.153.236.42 180.153.236.43 180.153.236.44 180.153.236.45 180.153.236.46 180.153.236.47 180.153.236.48 180.153.236.49 180.153.236.50 180.153.236.51 180.153.236.52 180.153.236.53 180.153.236.54 180.153.236.55 180.153.236.56 180.153.236.57 180.153.236.58 180.153.236.59 180.153.236.60 180.153.236.61 180.153.236.62 180.153.236.63 180.153.236.64 180.153.236.65 180.153.236.66 180.153.236.67 180.153.236.68 180.153.236.69 180.153.236.70 180.153.236.71 180.153.236.72 180.153.236.73 180.153.236.74 180.153.236.101 180.153.236.102 180.153.236.103 180.153.236.104 180.153.236.105 180.153.236.106 180.153.236.107 180.153.236.108 180.153.236.109 180.153.236.110 180.153.236.111 180.153.236.112 180.153.236.113 180.153.236.114 180.153.236.115 180.153.236.116 180.153.236.117 180.153.236.118 180.153.236.119 180.153.236.120 180.153.236.121 180.153.236.122 180.153.236.123 180.153.236.124 180.153.236.125 180.153.236.126 180.153.236.127 180.153.236.128 180.153.236.129 180.153.236.130 180.153.236.131 180.153.236.132 180.153.236.133 180.153.236.134 180.153.236.135 180.153.236.136 180.153.236.137 180.153.236.138 180.153.236.139 180.153.236.140 180.153.236.149 180.153.236.150 180.153.236.151 180.153.236.152 180.153.236.153 180.153.236.154 180.153.236.155 180.153.236.156 180.153.236.157 180.153.236.158 180.153.236.159 180.153.236.160 180.153.236.161 180.153.236.162 180.153.236.163 180.153.236.164 180.153.236.165 180.153.236.166 180.153.236.167 180.153.236.168 180.153.236.169 180.153.236.170 180.153.236.171 180.153.236.172 180.153.236.173 180.153.236.174 180.153.236.175 180.153.236.176 180.153.236.177 180.153.236.178 180.153.236.179 180.153.236.180 180.153.236.181 180.153.236.182 180.153.236.183 180.153.236.184 180.153.236.185 180.153.236.186 180.153.236.187 180.153.236.188 180.153.236.189 180.153.236.190 180.153.236.191 180.153.236.192 180.153.236.193 180.153.236.194 180.153.236.195 180.153.236.196 180.153.232.170 180.153.232.171 180.153.232.172 180.153.232.173 180.153.232.174 180.153.232.175 180.153.232.176 180.153.232.177 180.153.234.145 180.153.234.146 180.153.234.147 180.153.234.148 180.153.234.149 180.153.234.150 180.153.234.151 180.153.234.152
下面是百度搜索引擎的蜘蛛段:
下面這些ip段是百度蜘蛛IP的造訪,準(zhǔn)備來(lái)抓取你網(wǎng)站的網(wǎng)頁(yè)蜘蛛。
60.172.229.61
61.129.45.72
61.135.162.*
下面這些ip段是百度競(jìng)價(jià)蜘蛛。
61.135.165.134
117.34.74.66
118.122.188.194
119.63.196.9
125.39.78.185
下面這個(gè)ip段是百度聯(lián)盟蜘蛛爬蟲(chóng),其實(shí)就是百度統(tǒng)計(jì)的蜘蛛。
61.135.186.*
下面這幾個(gè)ip段是站長(zhǎng)工具上的模仿百度蜘蛛。
61.147.98.146
61.188.39.16
113.98.254.245
117.21.220.245
117.28.255.42
下面這個(gè)ip是搜外站長(zhǎng)工具的模仿百度蜘蛛。
124.248.34.52
下面這個(gè)ip和ip段是114站長(zhǎng)工具箱的蜘蛛,在你網(wǎng)站不是很穩(wěn)定的情況下會(huì)經(jīng)常過(guò)來(lái)的。
119.147.114.213
121.10.141.*
這個(gè)ip段是百度圖片蜘蛛的。
123.15.**.**
這個(gè)ip段是抓取網(wǎng)站內(nèi)頁(yè)收錄的,但是由于文章權(quán)重比較低,被爬過(guò)的內(nèi)頁(yè)文章暫時(shí)不會(huì)放出來(lái),需要考察一段時(shí)間,因?yàn)椴皇窃瓌?chuàng)的文章。(百度圖片爬蟲(chóng))
123.125.71.*
下面這個(gè)ip段是屬于百度蜘蛛IP,是你經(jīng)常用一些站長(zhǎng)工具檢測(cè)后造成的,基本是沒(méi)有多大用的。
125.90.88.*
下面這些ip段為百度考察期蜘蛛,也有可能是降權(quán)蜘蛛,因?yàn)橛腥苏f(shuō)過(guò)他網(wǎng)站被K的時(shí)候網(wǎng)站全是這個(gè)蜘蛛,或者是百度人工。
159.226.50.*
180.76.5.*
180.76.5.87
220.181.158.107
這個(gè)是偽裝百度蜘蛛的一個(gè)IP段。
180.149.130.*
這個(gè)ip段出現(xiàn)在新站及站點(diǎn)有不正?,F(xiàn)象后的時(shí)候。
183.91.40.144
203.208.60.*
這個(gè)ip段不間斷巡邏各站,就是路過(guò)一下,是來(lái)打醬油的,不用擔(dān)心啥。
210.72.225.*
如果發(fā)現(xiàn)下面這幾個(gè)ip段每天只增不減的話(huà),那就很危險(xiǎn)了,很有可能會(huì)進(jìn)入沙盒或者有被K站的現(xiàn)象。
123.125.68.*
218.30.118.102
220.181.68.*
這個(gè)ip段主要是抓取首頁(yè)占80%,內(nèi)頁(yè)占30%,此ip爬過(guò)的文章或首頁(yè),絕對(duì)24小時(shí)內(nèi)放出來(lái)和隔夜快照的!一般成功抓取返回代碼都是 200 0 0返回304 0 0代表網(wǎng)站沒(méi)更新,蜘蛛來(lái)過(guò),如果是 200 0 64別擔(dān)心這不是K站,可能是網(wǎng)站是動(dòng)態(tài)的,所以返回就是這個(gè)代碼。
220.181.108.*
下面的ip段代表百度蜘蛛IP來(lái)過(guò)了,準(zhǔn)備抓取你網(wǎng)站上的東西!
123.125.66.*
220.181.7.*
這個(gè)ip段是百度蜘蛛作為度過(guò)新站考察期的一個(gè)ip段。
121.14.89.*
這個(gè)是百度抓取首頁(yè)的專(zhuān)用IP如是220.181.108段的ip來(lái)的話(huà)基本來(lái)說(shuō)網(wǎng)站會(huì)天天隔夜快照,一般是不會(huì)出錯(cuò)的!偷偷的笑吧!
220.181.108.95
下面這個(gè)ip是98%抓取首頁(yè)可能還會(huì)抓取其他(不是指內(nèi)頁(yè))屬于百度的權(quán)重IP段,此ip段爬過(guò)的文章或首頁(yè)正常情況下基本在24小時(shí)都會(huì)放出來(lái),偷偷的笑吧!
220.181.108.92
下面這個(gè)ip屬于綜合的,主要是用來(lái)抓取首頁(yè)和內(nèi)頁(yè)或者其它頁(yè)面的,也是屬于一個(gè)權(quán)重IP,基本被抓過(guò)的文章或首頁(yè)24小時(shí)就會(huì)放出來(lái)。
220.181.108.91
下面這個(gè)ip是重點(diǎn)抓取更新文章的,內(nèi)頁(yè)達(dá)到90%,首頁(yè)抓取達(dá)到8%,2%其他權(quán)重ip段,基本被抓過(guò)的文章或首頁(yè)24小時(shí)就會(huì)放出來(lái)。
220.181.108.75
下面這些ip是抓取內(nèi)頁(yè)收錄的,權(quán)重相對(duì)比較低,爬過(guò)此段的內(nèi)頁(yè)文章不會(huì)很快被放出來(lái),因它懷疑不是原創(chuàng)文章或者懷疑是采集來(lái)的文章。
123.125.71.95
123.125.71.97
123.181.108.77
123.125.71.106
下面這些ip是專(zhuān)用抓取網(wǎng)站首頁(yè)的,也屬于權(quán)重段,一般返回代碼304 0 0就代表網(wǎng)站未更新。
220.181.108.89
220.181.108.94
220.181.108.97
220.181.108.80
220.181.108.77
220.181.108.83
220.181.108.86