Visual Basic 6.0
Visual Basic 6.0
Setting a Maximum URL Length
See more Spider Examples
The MaxUrlLen property prevents the spider from retrieving URLs that grow too long. The default value of MaxUrlLen is 300.Chilkat Visual Basic 6.0 Downloads
Dim spider As New ChilkatSpider
spider.Initialize "www.chilkatsoft.com"
' Add the 1st URL:
spider.AddUnspidered "http://www.chilkatsoft.com/"
' This example demonstrates setting the MaxUrlLen property
' Do not add URLs longer than 250 characters to the "unspidered" queue:
spider.MaxUrlLen = 250
' ..