Sample code for 30+ languages & platforms
Delphi DLL

Setting a Maximum URL Length

See more Spider Examples

The MaxUrlLen property prevents the spider from retrieving URLs that grow too long. The default value of MaxUrlLen is 300.

Chilkat Delphi DLL Downloads

Delphi DLL
uses
    Winapi.Windows, Winapi.Messages, System.SysUtils, System.Variants, System.Classes, Vcl.Graphics,
    Vcl.Controls, Vcl.Forms, Vcl.Dialogs, Vcl.StdCtrls, Spider;

...

procedure TForm1.Button1Click(Sender: TObject);
var
spider: HCkSpider;

begin
spider := CkSpider_Create();

CkSpider_Initialize(spider,'www.chilkatsoft.com');

// Add the 1st URL:
CkSpider_AddUnspidered(spider,'http://www.chilkatsoft.com/');

// This example demonstrates setting the MaxUrlLen property
// Do not add URLs longer than 250 characters to the "unspidered" queue:
CkSpider_putMaxUrlLen(spider,250);

// ..

CkSpider_Dispose(spider);

end;