(Chilkat2-Python) S3 List Objects in Bucket Folder

See more Amazon S3 Examples

Demonstrates how to retrieve the XML listing of the objects (i.e. files) stored in an Amazon S3 bucket, but just within a particular folder.

Chilkat2 Python Downloads install with pip pip3 install chilkat2 or download... Python Module for Windows, Linux, Alpine Linux, MacOS, Solaris

import sys
import chilkat2

# This example assumes the Chilkat HTTP API to have been previously unlocked.
# See Global Unlock Sample for sample code.

# In Amazon S3 (Simple Storage Service), there is a distinction between buckets and folders,
# which are both used for organizing and storing data.

# Bucket: A bucket is the top-level container in Amazon S3. It is similar to a directory or folder
# at the root level and acts as a unique namespace for your objects (files). Each bucket must have a globally
# unique name across all of Amazon S3. Buckets are created at the AWS account level and are used to store objects.

# Folder (Prefix): In Amazon S3, folders are not actual physical entities but are virtual constructs called prefixes.
# They are part of the object keys used to organize and group objects within a bucket. Object keys are essentially the
# full path or name of an object, including the folder structure. For example, if you have an object named
# "my-image.jpg" inside a folder named "photos," the object key would be "photos/my-image.jpg."
# Folders are helpful for organizing objects within a bucket and creating a hierarchical structure.

# In reality, S3 does not have a true folder structure. It stores objects in a flat structure with unique keys.
# However, the keys can include slashes ("/") to create a visual separation that resembles a folder structure.
# Various tools and S3 clients interpret the slashes as folder separators and display them accordingly.

http = chilkat2.Http()

# Insert your access key here:
http.AwsAccessKey = "AWS_ACCESS_KEY"

# Insert your secret key here:
http.AwsSecretKey = "AWS_SECRET_KEY"

# ----------------------------------------------------------------------------------
# List the objects having prefix "images/"
# ----------------------------------------------------------------------------------
strXml = http.S3_ListBucketObjects("chilkat100?prefix=images/")
if (http.LastMethodSuccess != True):
    print(http.LastErrorText)
    sys.exit()

print("Response status code = " + str(http.LastStatus))

xml = chilkat2.Xml()
success = xml.LoadXml(strXml)
if (success != True):
    print(xml.LastErrorText)
    sys.exit()

# If the response status code was not 200, then the XML response is not a 
# listing of objects, but instead contains error information.
if (http.LastStatus != 200):
    print(xml.GetXml())
    print("Failed.")
    sys.exit()

# A sample response is shown below.
print(xml.GetXml())
print("----")

# Use this online tool to generate parsing code from sample XML: 
# Generate Parsing Code from XML

# Iterate over the bucket items and get information for each..
numItems = xml.NumChildrenHavingTag("Contents")
print("Number of bucket items = " + str(numItems))

dt = chilkat2.CkDateTime()

i = 0
while i < numItems :
    xml.I = i

    itemKey = xml.GetChildContent("Contents[i]|Key")
    itemSizeDecimalStr = xml.GetChildContent("Contents[i]|Size")
    lastModTimestamp = xml.GetChildContent("Contents[i]|LastModified")

    dt.SetFromRfc822(lastModTimestamp)
    # Get a local date/time.
    bLocal = True
    # dtObj is a CkDtObj
    dtObj = dt.GetDtObj(bLocal)

    print(str(i) + ": " + itemKey + ", " + itemSizeDecimalStr + ", " + str(dtObj.Day) + "-" + str(dtObj.Month)\
         + "-" + str(dtObj.Year) + ":" + str(dtObj.Hour) + ":" + str(dtObj.Minute))

    i = i + 1

# Sample output from the above loop:

# 0: images/africa/, 0, 11-6-2020:20:18
# 1: images/africa/giraffe.jpg, 262769, 11-6-2020:20:20
# 2: images/africa/lion.jpg, 1026769, 11-6-2020:20:20
# 3: images/sea_creatures/starfish123.jpg, 6229, 19-1-2017:10:45
# 4: images/sea_creatures/starfish.jpg, 6229, 19-1-2017:12:7