Tcl

Setting a Maximum URL Length

See more Spider Examples

The MaxUrlLen property prevents the spider from retrieving URLs that grow too long. The default value of MaxUrlLen is 300. Tcl

load ./chilkat.dll

set spider [new_CkSpider]

CkSpider_Initialize $spider "www.chilkatsoft.com"

# Add the 1st URL:
CkSpider_AddUnspidered $spider "http://www.chilkatsoft.com/"

# This example demonstrates setting the MaxUrlLen property
# Do not add URLs longer than 250 characters to the "unspidered" queue:
CkSpider_put_MaxUrlLen $spider 250

# ..

delete_CkSpider $spider