Chilkat Examples

ChilkatHOME.NET Core C#Android™AutoItCC#C++Chilkat2-PythonCkPythonClassic ASPDataFlexDelphi ActiveXDelphi DLLGoJavaLianjaMono C#Node.jsObjective-CPHP ActiveXPHP ExtensionPerlPowerBuilderPowerShellPureBasicRubySQL ServerSwift 2Swift 3,4,5...TclUnicode CUnicode C++VB.NETVBScriptVisual Basic 6.0Visual FoxProXojo Plugin

Node.js Examples

Web API Categories

ASN.1
AWS KMS
AWS Misc
Amazon EC2
Amazon Glacier
Amazon S3
Amazon S3 (new)
Amazon SES
Amazon SNS
Amazon SQS
Async
Azure Cloud Storage
Azure Key Vault
Azure Service Bus
Azure Table Service
Base64
Bounced Email
Box
CAdES
CSR
CSV
Certificates
Compression
DKIM / DomainKey
DNS
DSA
Diffie-Hellman
Digital Signatures
Dropbox
Dynamics CRM
EBICS
ECC
Ed25519
Email Object
Encryption
FTP
FileAccess
Firebase
GMail REST API
GMail SMTP/IMAP/POP
Geolocation
Google APIs
Google Calendar
Google Cloud SQL
Google Cloud Storage
Google Drive
Google Photos
Google Sheets
Google Tasks
Gzip
HTML-to-XML/Text
HTTP

HTTP Misc
IMAP
JSON
JSON Web Encryption (JWE)
JSON Web Signatures (JWS)
JSON Web Token (JWT)
Java KeyStore (JKS)
MHT / HTML Email
MIME
MS Storage Providers
Microsoft Graph
Misc
NTLM
OAuth1
OAuth2
OIDC
Office365
OneDrive
OpenSSL
Outlook
Outlook Calendar
Outlook Contact
PDF Signatures
PEM
PFX/P12
PKCS11
POP3
PRNG
REST
REST Misc
RSA
SCP
SCard
SFTP
SMTP
SSH
SSH Key
SSH Tunnel
ScMinidriver
SharePoint
SharePoint Online
Signing in the Cloud
Socket/SSL/TLS
Spider
Stream
Tar Archive
ULID/UUID
Upload
WebSocket
XAdES
XML
XML Digital Signatures
XMP
Zip
curl

 

 

 

(Node.js) CanonicalizeUrl

The CanonicalizeUrl method is a utility function that canonicalizes a URL into a standard form to avoid duplicates. For example, "http://www.chilkatsoft.com/" and "http://www.chilkatsoft.com/default.asp" are the same URL.

Install Chilkat for Node.js and Electron using npm at

Chilkat npm packages for Node.js

Chilkat npm packages for Electron

on Windows, Linux, MacOSX, and ARM

var os = require('os');
if (os.platform() == 'win32') {  
    if (os.arch() == 'ia32') {
        var chilkat = require('@chilkat/ck-node17-win-ia32');
    } else {
        var chilkat = require('@chilkat/ck-node17-win64'); 
    }
} else if (os.platform() == 'linux') {
    if (os.arch() == 'arm') {
        var chilkat = require('@chilkat/ck-node17-arm');
    } else if (os.arch() == 'x86') {
        var chilkat = require('@chilkat/ck-node17-linux32');
    } else {
        var chilkat = require('@chilkat/ck-node17-linux64');
    }
} else if (os.platform() == 'darwin') {
    var chilkat = require('@chilkat/ck-node17-macosx');
}

function chilkatExample() {

    var spider = new chilkat.Spider();

    // Does a DNS lookup to find the default domain, which may or may not include the "www." depending on the DNS results.
    // Also domain names are converted to lowercase:
    console.log(spider.CanonicalizeUrl("http://www.ChilkatSoft.com/"));

    // CanonicalizeUrl will drop the HTML fragment:
    console.log(spider.CanonicalizeUrl("http://www.chilkatsoft.com/purchase2.asp#buyZip"));

    // If a username/password is in the URL, it gets dropped:
    console.log(spider.CanonicalizeUrl("http://username:password@www.chilkatsoft.com/purchase2.asp#buyZip"));

    // Port 80 and 443 are dropped:
    console.log(spider.CanonicalizeUrl("http://www.chilkatsoft.com:80/purchase2.asp"));
    console.log(spider.CanonicalizeUrl("https://www.paypal.com:443/"));

    // Removes default pages:
    // default.asp, index.html, index.htm, default.html, index.htm, default.htm
    // index.php, index.asp, default.php, .cfm, .aspx, ,php3, .pl, .cgi, .txt, .shtml, .phtml
    console.log(spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.asp"));
    console.log(spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.asp"));
    console.log(spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.php"));
    console.log(spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.pl"));
    console.log(spider.CanonicalizeUrl("http://www.chilkatsoft.com/index.htm"));

    // Output:
    // http://chilkatsoft.com/
    // http://chilkatsoft.com/purchase2.asp
    // http://chilkatsoft.com/purchase2.asp
    // http://chilkatsoft.com/purchase2.asp
    // https://www.paypal.com/
    // http://chilkatsoft.com/
    // http://chilkatsoft.com/
    // http://chilkatsoft.com/
    // http://chilkatsoft.com/
    // http://chilkatsoft.com

}

chilkatExample();

 

© 2000-2023 Chilkat Software, Inc. All Rights Reserved.