(PureBasic) Setting a Maximum Response Size

The MaxResponseSize property protects your spider from downloading a page that is too large. By default, MaxResponseSize = 0, which indicates that there is no maximum. You may set it to a number indicating the maximum number of bytes to download. URLs with response sizes larger than this will be skipped.

Chilkat PureBasic Module Download Chilkat PureBasic Module

IncludeFile "CkSpider.pb"

Procedure ChilkatExample()

    spider.i = CkSpider::ckCreate()
    If spider.i = 0
        Debug "Failed to create object."
        ProcedureReturn
    EndIf

    CkSpider::ckInitialize(spider,"www.chilkatsoft.com")

    ; Add the 1st URL:
    CkSpider::ckAddUnspidered(spider,"http://www.chilkatsoft.com/")

    ; This example demonstrates setting the MaxResponseSize property
    ; Do not download anything with a response size greater than 100,000 bytes.
    CkSpider::setCkMaxResponseSize(spider, 100000)


    CkSpider::ckDispose(spider)


    ProcedureReturn
EndProcedure