Delphi DLL

Setting a Maximum Response Size

See more Spider Examples

The MaxResponseSize property protects your spider from downloading a page that is too large. By default, MaxResponseSize = 0, which indicates that there is no maximum. You may set it to a number indicating the maximum number of bytes to download. URLs with response sizes larger than this will be skipped. Delphi DLL

uses
    Winapi.Windows, Winapi.Messages, System.SysUtils, System.Variants, System.Classes, Vcl.Graphics,
    Vcl.Controls, Vcl.Forms, Vcl.Dialogs, Vcl.StdCtrls, Spider;

...

procedure TForm1.Button1Click(Sender: TObject);
var
spider: HCkSpider;

begin
spider := CkSpider_Create();

CkSpider_Initialize(spider,'www.chilkatsoft.com');

// Add the 1st URL:
CkSpider_AddUnspidered(spider,'http://www.chilkatsoft.com/');

// This example demonstrates setting the MaxResponseSize property
// Do not download anything with a response size greater than 100,000 bytes.
CkSpider_putMaxResponseSize(spider,100000);

CkSpider_Dispose(spider);

end;