(Ruby) S3 Streaming Upload with Expect: 100-continue

Demonstrates how to do an S3 streaming upload that includes an "Expect: 100-continue" request header. The purpose of sending an "Expect: 100-continue" header is to cleanly handle the case when the request fails, for whatever reason. (Failure reasons can be anything, such as a permissions problem, invalid authentication, etc.)

If no "Expect: 100-continue" header is included, and the AWS server rejects the request immediately after receiving the header, then this is what happens: The server closes the connection immediately after processing the request header. This results in a half-closed connection. Meanwhile, the client continues with sending the file data in the body of the HTTP request. Eventually, because nothing is consuming the data on the server-side, the outgoing socket buffer on the client (i.e. local machine) fills up, and an error such as "WSAECONNABORTED An established connection was aborted by the software in your host machine." is returned.

When the "Expect: 100-continue" is inclued, the server sends a response immediately after receiving the request header. A 100 response status code indicates that all is OK and the client should continue with sending the request body (i.e. file data), after which the server will respond with a final response.

Chilkat Ruby Downloads install from rubygems.org gem install chilkat or download... Ruby Library for Windows, MacOS, Linux, Alpine Linux

require 'chilkat'

# This example requires the Chilkat API to have been previously unlocked.
# See Global Unlock Sample for sample code.

# This first part is optional.  AWS authentication requires
# the SHA-256 hash of the request body (i.e. the contents of the file
# to be uploaded).  We can choose to pre-calculate the SHA-256 in a streaming fashion
# and then provide it to the authenticator object.  This way, if the file is
# extremely large, it never needs to completely reside in memory.
crypt = Chilkat::CkCrypt2.new()
crypt.put_EncodingMode("hex")
crypt.put_HashAlgorithm("sha-256")
fileToUploadPath = "qa_data/xml/hamlet.xml"
hashStr = crypt.hashFileENC(fileToUploadPath)

rest = Chilkat::CkRest.new()

# Connect to the Amazon AWS REST server.
bTls = true
port = 443
bAutoReconnect = true
success = rest.Connect("s3.amazonaws.com",port,bTls,bAutoReconnect)

# ----------------------------------------------------------------------------
# Important: For buckets created in regions outside us-east-1,
# there are three important changes that need to be made.
# See Working with S3 Buckets in Non-us-east-1 Regions for the details.
# ----------------------------------------------------------------------------

# Provide AWS credentials for the REST call.
authAws = Chilkat::CkAuthAws.new()
authAws.put_AccessKey("AWS_ACCESS_KEY")
authAws.put_SecretKey("AWS_SECRET_KEY")
authAws.put_ServiceName("s3")
# Provide the pre-computed SHA-256 here:
authAws.put_PrecomputedSha256(hashStr)

success = rest.SetAuthAws(authAws)

# Add an Expect: 100-continue request header
rest.AddHeader("Expect","100-continue")

# Set the bucket name via the HOST header.
# In this case, the bucket name is "chilkat100".
rest.put_Host("chilkat100.s3.amazonaws.com")

fileStream = Chilkat::CkStream.new()
fileStream.put_SourceFile(fileToUploadPath)

# Upload to the S3 Storage service.
# If the application provided the SHA-256 hash of the file contents (as shown above)
# then file is streamed and never has to completely reside in memory.
# If the application did NOT provide the SHA-256, then Chilkat will (internally) 
# load the entire file into memory, calculate the SHA-256, and then upload.
responseStr = rest.fullRequestStream("PUT","/hamlet.xml",fileStream)
if (rest.get_LastMethodSuccess() != true)
    print rest.lastErrorText() + "\n";
    exit
end

# When successful, the S3 Storage service will respond with a 200 response code,
# with an XML body.  
if (rest.get_ResponseStatusCode() == 200)
    print responseStr + "\n";
    print "File uploaded." + "\n";
else
    # Examine the request/response to see what happened.
    print "response status code = " + rest.get_ResponseStatusCode().to_s() + "\n";
    print "response status text = " + rest.responseStatusText() + "\n";
    print "response header: " + rest.responseHeader() + "\n";
    print "response body: " + responseStr + "\n";
    print "---" + "\n";
    print "LastRequestStartLine: " + rest.lastRequestStartLine() + "\n";
    print "LastRequestHeader: " + rest.lastRequestHeader() + "\n";
end