Saturday, August 29, 2009

bitlybot

Just found in web server log:

Agent: bitlybot

it is some bot from Bit.ly URL shortening service. Interesting, why do they need a bot? Do they create an own index for "active" URL's? Archivating them or what?

No comments: