Unicode C++
Unicode C++
Setting a Maximum URL Length
See more Spider Examples
The MaxUrlLen property prevents the spider from retrieving URLs that grow too long. The default value of MaxUrlLen is 300.Chilkat Unicode C++ Downloads
#include <CkSpiderW.h>
void ChilkatSample(void)
{
CkSpiderW spider;
spider.Initialize(L"www.chilkatsoft.com");
// Add the 1st URL:
spider.AddUnspidered(L"http://www.chilkatsoft.com/");
// This example demonstrates setting the MaxUrlLen property
// Do not add URLs longer than 250 characters to the "unspidered" queue:
spider.put_MaxUrlLen(250);
// ..
}