AutoIt

Setting a Maximum URL Length

See more Spider Examples

The MaxUrlLen property prevents the spider from retrieving URLs that grow too long. The default value of MaxUrlLen is 300. AutoIt

$oSpider = ObjCreate("Chilkat.Spider")

$oSpider.Initialize "www.chilkatsoft.com"

; Add the 1st URL:
$oSpider.AddUnspidered "http://www.chilkatsoft.com/"

; This example demonstrates setting the MaxUrlLen property
; Do not add URLs longer than 250 characters to the "unspidered" queue:
$oSpider.MaxUrlLen = 250

; ..