Unicode C
Unicode C
Setting a Maximum URL Length
See more Spider Examples
The MaxUrlLen property prevents the spider from retrieving URLs that grow too long. The default value of MaxUrlLen is 300.Chilkat Unicode C Downloads
#include <C_CkSpiderW.h>
void ChilkatSample(void)
{
HCkSpiderW spider;
spider = CkSpiderW_Create();
CkSpiderW_Initialize(spider,L"www.chilkatsoft.com");
// Add the 1st URL:
CkSpiderW_AddUnspidered(spider,L"http://www.chilkatsoft.com/");
// This example demonstrates setting the MaxUrlLen property
// Do not add URLs longer than 250 characters to the "unspidered" queue:
CkSpiderW_putMaxUrlLen(spider,250);
// ..
CkSpiderW_Dispose(spider);
}