HNGlance

Top Best New Show

Googlebot Running Javascript

http://www.jefftk.com/news/2012-01-11.html

by cbr • 15 years ago

1 1 15 years ago

JE

Related Stories

Loading related stories...

Comments

1

infinity• 15 years ago

One important information is missing here: the IP address of the crawler, the official Googlebot can then be identified. There are so many bots out there disguised as Googlebots, most of them do weird things: scanning for log-in pages, sending POST requests with spam, searching for vulnerable sites.

The Googlebot has been seen using POST requests and executing JavaScript for some time now. There is even an official article on this topic on the Google Webmaster Central blog:

http://googlewebmastercentral.blogspot.com/2011/11/get-post-... (from Nov. 2011)

Source preview

jefftk.com

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms