Chilkat2-Python

Chunked Compression Using CompressBd2 with FirstChunk and LastChunk

See more Compression Examples

This example demonstrates how to compress data in multiple segments using the CompressBd2 method together with the FirstChunk and LastChunk properties. Instead of compressing all data in a single call, the input is divided into smaller chunks and processed sequentially, which is useful when handling streaming data or large inputs.

The example shows how to correctly mark the first, middle, and final chunks so that the compression stream is properly initialized and finalized. The compressed output is accumulated in a separate BinData object without modifying the input chunks. Finally, the example decompresses the combined result to verify that the original data is restored correctly.

This approach is ideal for scenarios where data is received incrementally, such as reading from a network stream, processing large files in parts, or handling real-time data feeds.

Chilkat2-Python

import sys
import chilkat2

success = False

# This example assumes the Chilkat API has already been unlocked.
# See Global Unlock Sample for sample code.

compress = chilkat2.Compression()
compress.Algorithm = "zlib"

# This will accumulate the compressed output.
bdOut = chilkat2.BinData()

# ------------------------------------------------------------------
# Simulate input arriving in chunks.
# ------------------------------------------------------------------

part1 = "The quick brown fox "
part2 = "jumps over the lazy dog. "
part3 = "This text is split into chunks."

# ------------------------------------------------------------------
# Compress the first chunk
# ------------------------------------------------------------------

compress.FirstChunk = True
compress.LastChunk = False

bdIn = chilkat2.BinData()
bdIn.AppendString(part1,"utf-8")

success = compress.CompressBd2(bdIn,bdOut)
if (success == False):
    print(compress.LastErrorText)
    sys.exit()

# ------------------------------------------------------------------
# Compress a middle chunk
# ------------------------------------------------------------------

compress.FirstChunk = False
compress.LastChunk = False

bdIn.Clear()
bdIn.AppendString(part2,"utf-8")

success = compress.CompressBd2(bdIn,bdOut)
if (success == False):
    print(compress.LastErrorText)
    sys.exit()

# ------------------------------------------------------------------
# Compress the final chunk
# ------------------------------------------------------------------

compress.FirstChunk = False
compress.LastChunk = True

bdIn.Clear()
bdIn.AppendString(part3,"utf-8")

success = compress.CompressBd2(bdIn,bdOut)
if (success == False):
    print(compress.LastErrorText)
    sys.exit()

# Get the final compressed result as base64 for display
compressedBase64 = bdOut.GetEncoded("base64")

print("Compressed data (base64):")
print(compressedBase64)

# ------------------------------------------------------------------
# Decompress to verify correctness
# ------------------------------------------------------------------

bdDecompressed = chilkat2.BinData()

compress.FirstChunk = True
compress.LastChunk = True

success = compress.DecompressBd2(bdOut,bdDecompressed)
if (success == False):
    print(compress.LastErrorText)
    sys.exit()

# Convert decompressed bytes back to a string
resultText = bdDecompressed.GetString("utf-8")

print("Decompressed text:")
print(resultText)