Skip to main content
In an image classification system, the pipeline analyzes each frame of a video stream and assigns labels that reflect the scene’s content such as identified objects or scene categories. Let’s walk through an example of building an image classification pipeline with the QIM SDK using the ResNeXt101 image classification model which can be downloaded from Qualcomm’s AI Hub. Here is what our pipeline in this example will look like: Diagram of image classification pipeline
You can refer to the Building AI Pipelines for more general information about each element of an AI pipeline

​
Run example on device

1

Download Required Files

If any downloaded file is a .zip archive, extract it on your host machine before copying: unzip filename.zip
2

Copy files to device

Create the required directories and transfer the downloaded files to your device.
3

Connect to device

4

Set environment variables

5

Run example on device

​
Expected output

The result of the video classification is visually overlaid in the top-left corner of the frame. Image of a camel classification

​
Stream Splitting via tee

One of the powerful features of GStreamer is the ability to split a video or audio stream into multiple branches, allowing the same stream to be processed or consumed in different ways simultaneously. In this example, we are using the tee element to split the original video stream. One branch runs through the AI processing pipeline to generate classifications, and at the end it is recombined with the original video stream so that the detected label can be displayed on top of the original image. Note that each branch connected to a tee runs on its own thread, so you often need queue elements after each branch to avoid blocking.

​
Combining inference results with the original image

The qtimetamux attaches the AI inference results to the original NV12 video frame as custom GStreamer metadata. This ensures synchronization between the video frame and its associated AI metadata, allowing downstream elements to seamlessly access both for visualization, network streaming, or automated decision-making.

​
Adding a text overlay on top of the image

The qtivoverlay element reads the AI metadata and renders visual overlays, such as bounding boxes and labels, directly onto the video frame without requiring buffer duplication.