Search

Recent Posts

Tags


« | Main | »

Abuse from BingBot – 2012

By Dale Reagan | March 13, 2012

Stardate errr, ummm, well 3/12/2012 (Monday.)

Hopefully this will not persist…

Update 3/15/2012

Late in the day on 3/14/2012 I received an email response from Bingbot that indicated that there was a ‘bug’ in Bingbot causing this issue and that it was being ‘actively investigated’…  I restored Bingbot access but I continue to see ‘strange’ errors – folks should check their Bingbot 404 errors…

Update 3/22/2012

Ok, I’m impressed with the BingBot team – communication is key for any issue that needs resolution and in this case I both believe and appreciate the response that I have seen from Microsoft.  Seems that this issue was an un-common edge case that was triggered by an error on one of my sites – yet another reason to review/check your links… (and yes, the problem link in my content was on an ‘old’ page which ‘link checkers’ did not note…)

Why is Bingbot acting BrainDead?

My Guesses  about Bingbot Bad Behaviours

  1. BingBot has been Hacked? Or
  2. No one is at home? to review what the bot is doing?
  3. Pushing out ‘new code’ too soon????

I will lean towards item #1 (since I have been systematically banning/denying all bots from China or any bot doing anything that I think is ‘bad’…)

Where’s the BEEF?

The Current 404 stats from Bingbot during the past week (3/12 to 3/2/2012):

##################################################################
# Bingbot 404 Count for today: 616 | Non-404's: 65 | All: 681 (3/12/2012)
##################################################################
####################################################################################
# Cnt:     5012 /chk.bingbot.log.072.bngbot.all.txt | Robots: 60 | 404 Count: 4532 #
####################################################################################
        *********** Scanning_IPs ***********
  1.   318 404's | 65.52.109.19 | 19.109.52.65.in-addr.arpa domain name pointer msnbot-65-52-109-19.search.msn.com.
  2.   237 404's | 65.52.108.68 | 68.108.52.65.in-addr.arpa domain name pointer msnbot-65-52-108-68.search.msn.com.
  3.   219 404's | 65.52.110.143 | 143.110.52.65.in-addr.arpa domain name pointer msnbot-65-52-110-143.search.msn.com.
  4.   217 404's | 65.52.109.194 | 194.109.52.65.in-addr.arpa domain name pointer msnbot-65-52-109-194.search.msn.com.
  5.   173 404's | 207.46.13.100 | 100.13.46.207.in-addr.arpa domain name pointer msnbot-207-46-13-100.search.msn.com.
  6.   155 404's | 207.46.204.232 | 232.204.46.207.in-addr.arpa domain name pointer msnbot-207-46-204-232.search.msn.com.
  7.   155 404's | 157.55.16.222 | 222.16.55.157.in-addr.arpa domain name pointer msnbot-157-55-16-222.search.msn.com.
  8.   154 404's | 65.52.110.22 | 22.110.52.65.in-addr.arpa domain name pointer msnbot-65-52-110-22.search.msn.com.
  9.   134 404's | 207.46.13.160 | 160.13.46.207.in-addr.arpa domain name pointer msnbot-207-46-13-160.search.msn.com.
 10.   126 404's | 207.46.199.35 | 35.199.46.207.in-addr.arpa domain name pointer msnbot-207-46-199-35.search.msn.com.
 11.   114 404's | 65.52.110.199 | 199.110.52.65.in-addr.arpa domain name pointer msnbot-65-52-110-199.search.msn.com.
 12.   105 404's | 207.46.13.98 | 98.13.46.207.in-addr.arpa domain name pointer msnbot-207-46-13-98.search.msn.com.
 13.    99 404's | 65.52.109.72 | 72.109.52.65.in-addr.arpa domain name pointer msnbot-65-52-109-72.search.msn.com.
 14.    89 404's | 157.55.18.26 | 26.18.55.157.in-addr.arpa domain name pointer msnbot-157-55-18-26.search.msn.com.
 15.    88 404's | 157.55.16.177 | 177.16.55.157.in-addr.arpa domain name pointer msnbot-157-55-16-177.search.msn.com.
 16.    85 404's | 207.46.199.50 | 50.199.46.207.in-addr.arpa domain name pointer msnbot-207-46-199-50.search.msn.com.
 17.    81 404's | 207.46.13.50 | 50.13.46.207.in-addr.arpa domain name pointer msnbot-207-46-13-50.search.msn.com.
 18.    79 404's | 65.52.108.24 | 24.108.52.65.in-addr.arpa domain name pointer msnbot-65-52-108-24.search.msn.com.
 19.    75 404's | 157.55.17.193 | 193.17.55.157.in-addr.arpa domain name pointer msnbot-157-55-17-193.search.msn.com.
 20.    67 404's | 207.46.204.241 | 241.204.46.207.in-addr.arpa domain name pointer msnbot-207-46-204-241.search.msn.com.

I will review stats until this is resolved (well I will wait a few days for BingBot to Respond before implementing a complete (yes!) ban…

I will wait a few days and then I will follow up with approaches to banning BingBot OR I will report on the response from Bing.Com.

Not happy with Bing/MSN/etc… from the ‘bot-side’…  🙁

Wait! what about impacting your traffic from Bing?

While that is certainly a consideration I am only willing to tolerate ‘reasonable bots’ (perhaps a unique position but that is where  I am…)  My guess is that if enough folks ‘made noise’ about these types of issues then we would see fewer of them (I do understand in-frequent bot-tweaking but this is excessive; my first response to the problem was to create an additional robots exclusion  to stop the 404s; now the bot has adopted a new ‘404 pattern’ – I am not interested in creating an endless set of exclusions to try and reign in any bot…)

 

Topics: Computer Technology, Internet Search, Long Tail Search, Media and Communications, Problem Solving, Unix-Linux-Os, Web Problem Solving, Web Technologies | Comments Off on Abuse from BingBot – 2012

Comments are closed.


________________________________________________
YOUR GeoIP Data | Ip: 73.21.121.1
Continent: NA | Country Code: US | Country Name: United States
Region: | State/Region Name: | City:
(US only) Area Code: 0 | Postal code/Zip:
Latitude: 38.000000 | Longitude: -97.000000
Note - if using a mobile device your physical location may NOT be accurate...
________________________________________________

Georgia-USA.Com - Web Hosting for Business
____________________________________