Function CheckSearchRobots(SearchRobotsAgent) CheckSearchRobots = False '自定义搜索爬虫,因篇幅关系,这里只是加入国内主要搜索引擎爬虫部分记录 Dim SearchRobots:SearchRobots="Baidu@Baidu|Google@Google|crawler@alexa|Yahoo@Yahoo|sohu@Sohu|MSN@MSN|QihooBot@Qihoo" dim ArrSearchRobots,ArrSearchRobots2,SearchRobotsTrue,SearchRobotsName,iSearchRobots SearchRobotsTrue = False ArrSearchRobots = split(SearchRobots,chr(124)) For iSearchRobots = 0 To Ubound(ArrSearchRobots) ArrSearchRobots2 = split(ArrSearchRobots(iSearchRobots),"@") If Instr(lcase(SearchRobotsAgent),lcase(ArrSearchRobots2(0))) > 0 then SearchRobotsTrue=true:SearchRobotsName=ArrSearchRobots2(1):exit for End If Next If SearchRobotsTrue and len(SearchRobotsName)>0 then'如果是爬虫,就更新爬虫信息 CheckSearchRobots = True End If End Function
将以上代码放在asp程序中(具体如何放置请参考相关文章),然后在需要调用的地方作如下调用: If CheckSearchRobots(SearchRobotsAgent) = False Then Response.Write "非搜索引擎,可作部分限制!" '这里可以加入判断指定时间的刷新次数,比如在正常情况下,访问速度是N次/分,如果超过这个次数(超常规访问)就可以限制了。