IP Addresses of Search Engine Spiders
March 29th, 2007 by mescalito
Вы можете посмотреть списки IP адресов поисковых роботов здесь :
Google IP List
List of the IP addresses of the various Googlebots and Mediabots.
Last revised Thursday, 05-Oct-2006 22:53:48 EDT Size: 4k
Yahoo IP List
List of the IP addresses of Yahoo/Inktomi bots.
Last revised Monday, 12-Mar-2007 20:17:49 EDT Size: 11k
Lycos IP List
List of the IP addresses of Lycos bots.
Last revised Tuesday, 15-Nov-2005 11:41:27 EST Size: 1k
InfoSeek IP List
List of the IP addresses of InfoSeek bots.
Last revised Monday, 07-Jun-2004 13:23:45 EDT Size: 1k
Alta Vista IP List
List of the IP addresses of Alta Vista bots.
Last revised Monday, 25-Sep-2006 22:37:21 EDT Size: 2k
Excite IP List
List of the IP addresses of Excite bots.
Last revised Wednesday, 12-Apr-2006 17:55:34 EDT Size: 1k
Northern Light IP List
List of the IP addresses of Northern Light bots.
Last revised Wednesday, 31-Jul-2002 14:13:28 EDT Size: 1k
Misc IP List
List of the IP addresses of various search engines’ bots.
Last revised Monday, 12-Mar-2007 20:17:51 EDT Size: 60k
Non Spiders
List of IP addresses and some User Agents of non-search engine spider bots, along with some other pertinent information.
Last revised Monday, 18-Apr-2005 11:25:10 EDT Size: 7k
Ещё ihategoogle.org
