Chilkat HOME Android™ Classic ASP C C++ C# Mono C# .NET Core C# C# UWP/WinRT DataFlex Delphi ActiveX Delphi DLL Visual FoxPro Java Lianja MFC Objective-C Perl PHP ActiveX PHP Extension PowerBuilder PowerShell PureBasic CkPython Chilkat2-Python Ruby SQL Server Swift 2 Swift 3/4 Tcl Unicode C Unicode C++ Visual Basic 6.0 VB.NET VB.NET UWP/WinRT VBScript Xojo Plugin Node.js Excel Go
(Ruby) FTP Large File Upload
Demonstrates how to use the LargeFileUpload method introduced in v220.127.116.11.
The LargeFileUpload method is the same as PutFile, but designed to work around the following potential problem associated with an upload that is extremely large.
FTP uses two TCP (or TLS) connections: a control connection to submit commands and receive replies, and a data connection for actual file transfers. It is the nature of FTP that during a transfer the control connection stays completely idle. Many routers and firewalls automatically close idle connections after a certain period of time. Worse, they often don't notify the user, but just silently drop the connection.
For FTP, this means that during a long transfer the control connection can get dropped because it is detected as idle, but neither client nor server are notified. When all data has been transferred, the server assumes the control connection is alive and it sends the transfer confirmation reply.
Likewise, the client thinks the control connection is alive and it waits for the reply from the server. But since the control connection got dropped without notification, the reply never arrives and eventually the connection will timeout.
The Solution: LargeFileUpload uploads the file in chunks, where each chunk appends to the remote file. This way, each chunk is a separate FTP upload that does not take too long to complete. The chunkSize specifies the number of bytes to upload in each chunk. The size should be based on the amount of memory available (because each chunk will reside in memory as it's being uploaded), the transfer rate, and the total size of the file being uploaded. For example, if a 4GB file is uploaded, and the chunkSize is set to 1MB (1,048,576 bytes), then 4000 separate chunks would be required. This is likely not a good choice for chunkSize. A more appropriate chunkSize might be 20MB, in which case the upload would complete in 200 separate chunks. The application would temporarily be using a 20MB buffer for uploading chunks. The tradeoff is between the number of chunks (the more chunks, the larger the overall time to upload), the amount of memory that is reasonable for the temporary buffer, and the amount of time required to upload each chunk (if the chunk size is too large, then the problem described above is not solved).
require 'chilkat' ftp = Chilkat::CkFtp2.new() # Any string unlocks the component for the 1st 30-days. success = ftp.UnlockComponent("Anything for 30-day trial") if (success != true) print ftp.lastErrorText() + "\n"; exit end ftp.put_Hostname("ftp.someFtpServer.com") ftp.put_Username("my-ftp-login") ftp.put_Password("my-ftp-password") # Connect and login to the FTP server. success = ftp.Connect() if (success != true) print ftp.lastErrorText() + "\n"; exit end # Change to the remote directory where the file will be uploaded. success = ftp.ChangeRemoteDir("junk") if (success != true) print ftp.lastErrorText() + "\n"; exit end localPath = "c:/temp/veryLargeFile.dat" remoteFilename = "veryLargeFile.dat" # Upload in chunks of 10 million bytes. chunkSize = 10000000 success = ftp.LargeFileUpload(localPath,remoteFilename,chunkSize) if (success != true) print ftp.lastErrorText() + "\n"; exit end success = ftp.Disconnect() print "Large File Uploaded!" + "\n";
© 2000-2019 Chilkat Software, Inc. All Rights Reserved.