Xojo Plugin

Multimodal Input: Image Data

See more AI Examples

Demonstrates sending a request that includes both text and image data for the AI to analyze. Xojo Plugin

Dim success As Boolean
success = False

// This example assumes the Chilkat API to have been previously unlocked.
// See Global Unlock Sample for sample code.

Dim ai As New Chilkat.Ai

// The provider can be "openai", "google", "claude", "deepseek", "xai", or "perplexity".
// Support for additional providers will be added in future versions of Chilkat.
// xAI (Grok) will be used here..
ai.Provider = "xai"

// Use your provider's API key.
ai.ApiKey = "MY_API_KEY"

// Choose a model.
ai.Model = "grok-4"

// Add both text input, and image data
success = ai.InputAddText("Describe what you see in the following image.")

Dim bd As New Chilkat.BinData
// We're passing a relative local file path here.. (relative the the app's current working directory)
success = bd.LoadFile("qa_data/jpg/starfish.jpg")
If (success = False) Then
    System.DebugLog(bd.LastErrorText)
    Return
End If

success = ai.InputAddImageData(bd,"")

// Ask the AI for text output.
success = ai.Ask("text")
If (success = False) Then
    System.DebugLog(ai.LastErrorText)
    Return
End If

// Get the text response.
Dim sbResponse As New Chilkat.StringBuilder
success = ai.GetOutputTextSb(sbResponse)
System.DebugLog(sbResponse.GetAsString())

// -------------------------------------------------------------
// The response is in markdown format.
// Also see Markdown to HTML Conversion Examples.
// -------------------------------------------------------------

// Sample output:

// The image depicts a small, bright orange starfish (also known as a sea star) with five symmetrical arms radiating from a central disc. 
// It has a textured, bumpy surface that gives it a realistic, almost spiky appearance, and there's a small hole or indentation at the center, 
// which might represent the mouth or a natural feature. The starfish is shown against a plain white background, and it appears to be a simple, 
// illustrative or clipart-style graphic rather than a photograph.