Chilkat HOME .NET Core C# Android™ AutoIt C C# C++ Chilkat2-Python CkPython Classic ASP DataFlex Delphi ActiveX Delphi DLL Go Java Lianja Mono C# Node.js Objective-C PHP ActiveX PHP Extension Perl PowerBuilder PowerShell PureBasic Ruby SQL Server Swift 2 Swift 3,4,5... Tcl Unicode C Unicode C++ VB.NET VBScript Visual Basic 6.0 Visual FoxPro Xojo Plugin
(PureBasic) Getting Started Spidering a SiteThis is a very simple "getting started" example for spidering a web site. As you'll see in future examples, the Chilkat Spider library can be used to crawl the Web. For now, we'll concentrate on spidering a single site.
IncludeFile "CkSpider.pb" Procedure ChilkatExample() spider.i = CkSpider::ckCreate() If spider.i = 0 Debug "Failed to create object." ProcedureReturn EndIf ; The spider object crawls a single web site at a time. As you'll see ; in later examples, you can collect outbound links and use them to ; crawl the web. For now, we'll simply spider 10 pages of chilkatsoft.com CkSpider::ckInitialize(spider,"www.chilkatsoft.com") ; Add the 1st URL: CkSpider::ckAddUnspidered(spider,"http://www.chilkatsoft.com/") ; Begin crawling the site by calling CrawlNext repeatedly. i.i For i = 0 To 9 success.i success = CkSpider::ckCrawlNext(spider) If success = 1 ; Show the URL of the page just spidered. Debug CkSpider::ckLastUrl(spider) ; The HTML is available in the LastHtml property Else ; Did we get an error or are there no more URLs to crawl? If CkSpider::ckNumUnspidered(spider) = 0 Debug "No more URLs to spider" Else Debug CkSpider::ckLastErrorText(spider) EndIf EndIf ; Sleep 1 second before spidering the next URL. CkSpider::ckSleepMs(spider,1000) Next CkSpider::ckDispose(spider) ProcedureReturn EndProcedure |
© 2000-2024 Chilkat Software, Inc. All Rights Reserved.