Multimedia

This section covers Python-based multimedia sample applications that demonstrate camera streaming, video playback, and transformation on Qualcomm platforms. The following tables list all available Python multimedia applications and their platform support. Select the appropriate configuration tab for your setup.

Config #1
Config #2

Application	Source code	Description	QCS6490	IQ-8275	IQ-9075	IQ-615
Camera encoding	`gst-camera-encode.py`	Records and encodes a single camera stream.	✓	✓	✓	✓
Camera Streaming using OpenCV	`gst-camera-opencv-resize.py`	Captures and resizes a camera stream using OpenCV.	✓	✓	✓	✓
Concurrent video playback (video wall) using Python	`gst-concurrent-videoplay-composition.py`	Concurrent MP4 (H.264) playback composed on a video wall.	✓	✓	✓	✓
Video transformation using OpenCV	`gst-opencv-transform.py`	Captures and transforms a video frame using OpenCV.	✓	✓	✓	✓
Decode JPEG images using Python	`gst-jpg-image-decode.py`	Decodes JPEG images and displays them on the screen.	✓	✓	✓	✓
Transform and encode a camera stream	`gst-camera-rotate-downscale-file.py`	Rotates, downscales, and encodes a camera stream to a file.	✓	✓	✓	✓

Application	Source code	Description	QCS6490	IQ-8275	IQ-9075	IQ-615
Camera encoding	`gst-camera-encode.py`	Records and encodes a single camera stream.	✓	✓	✓	✓
Camera Streaming using OpenCV	`gst-camera-opencv-resize.py`	Captures and resizes a camera stream using OpenCV.	✓	✓	✓	✓
Concurrent video playback (video wall) using Python	`gst-concurrent-videoplay-composition.py`	Concurrent MP4 (H.264) playback composed on a video wall.	✓	✓	✓	✓
Video transformation using OpenCV	`gst-opencv-transform.py`	Captures and transforms a video frame using OpenCV.	✓	✓	✓	✓
Multi-camera streaming using Python	`gst-multi-camera-stream-example.py`	Streams from two camera sensors simultaneously.	✓	✓	✓	×
Decode JPEG images using Python	`gst-jpg-image-decode.py`	Decodes JPEG images and displays them on the screen.	✓	✓	✓	✓
Transform and encode a camera stream	`gst-camera-rotate-downscale-file.py`	Rotates, downscales, and encodes a camera stream to a file.	✓	✓	✓	✓

Config 1: Supported Camera Slots by Platform

QCS6490
IQ-9075-EVK
IQ-8275-EVK
IQ615
IQx7181

Connect the IMX577 MIPI camera sensor to the CAM3 slot of the RB3 device.

Prerequisites

See the Prerequisites section in the Python AI page for device setup, Wi-Fi, artifact download, and enabling qticamsrc and libcamera.

Camera Applications

Camera Encoding

The gst-camera-encode.py application allows you to record and encode a single camera stream. For information about the plugins used in this pipeline, see Pipeline flow.

Application: gst-camera-encode.py

Try me

Complete prerequisites

Ensure that you complete the Prerequisites.

Run the application

gst-camera-encode.py

To display all available options:

gst-camera-encode.py -h

Pull output from device

scp root@<IP address of target device>:/etc/media/recording.mp4 .

Expected output

The output is saved in a file at /etc/media/recording.mp4.

Pipeline flow

Plugin	Description
`qticamsrc`	Captures the camera live stream. Capsfilter enforces constraints on raw video data.
`v4l2h264enc`	Encodes the video using H.264 format.
`h264parse`	Parses the encoded video.
`mp4mux`	Multiplexes the video into an MP4 container.
`filesink`	Writes the video to a file.

Camera Streaming Using OpenCV

The gst-camera-opencv-resize.py application uses OpenCV APIs to capture a camera frame from a live camera stream and apply color conversion or resize. The output is displayed on the screen. For information about the plugins used in this pipeline, see Pipeline flow.

Application: gst-camera-opencv-resize.py

Try me

Complete prerequisites

Ensure that you complete the Prerequisites.

Run the application

gst-camera-opencv-resize.py --inwidth 1280 --inheight 720 --outwidth 640 --outheight 480

To display all available options:

gst-camera-opencv-resize.py -h

Expected output

The stream is displayed on the screen.

Troubleshoot GTK backend failure in root mode

When running a GTK-based application as root, GTK may fail to initialize the backend. Export the active display session before running:

Pipeline flow

Plugin	Description
`qticamsrc`	Captures the video stream and feeds it into the capsfilter.
`capsfilter`	Enforces constraints on the raw video data.
`queue`	Buffers video data.
`qtivtransform`	Transforms the video data.
`waylandsink`	Displays the video stream on the Wayland display.

Multi-Camera Streaming Using Python

The gst-multi-camera-stream-example.py application streams from two camera sensors simultaneously, composing the feeds side by side or encoding to files. For information about the plugins used in this pipeline, see Pipeline flow.

Application: gst-multi-camera-stream-example.py

This application isn’t supported in the Config #1 of the QLI 2.0 RC3 release.

Try me

Complete prerequisites

Ensure that you complete the Prerequisites.

Run the application

Preview on display:

gst-multi-camera-stream-example.py -D 1 --width=1920 --height=1080

Encode to file:

gst-multi-camera-stream-example.py -D 0 --width=1920 --height=1080 --framerate=30/1

To display all available options:

gst-multi-camera-stream-example.py --help

Expected output

For the video composition pipeline, the output is displayed as a preview.

Pipeline flow

Pipeline	Description
Preview on display	`qticamsrc` (cam0 + cam1) → capsfilter → `qtivcomposer` → `waylandsink`
Encoder dump	`qticamsrc` (cam0 + cam1) → capsfilter → `v4l2h264enc` → `h264parse` → `mp4mux` → `filesink`

Decode JPEG Images Using Python

The gst-jpg-image-decode.py application decodes JPEG images and displays them on a screen. For information about the plugins used in this pipeline, see Pipeline flow.

Application: gst-jpg-image-decode.py

Try me

Complete prerequisites

Ensure that you complete the Prerequisites.

Run the application

gst-jpg-image-decode.py -i /etc/media/imagefiles_%d.jpg

To display all available options:

gst-jpg-image-decode.py -h

Expected output

The decoded images are displayed on the screen.

Pipeline flow

Plugin	Description
`multifilesrc`	Reads video data from sequentially named files.
`capsfilter`	Enforces constraints on the video data.
`jpegdec`	Decodes the JPEG video stream.
`videoconvert`	Converts video frames from one format to another.
`waylandsink`	Displays the video stream on the Wayland display.

Transform and Encode a Camera Stream

The gst-camera-rotate-downscale-file.py application rotates, downscales, and encodes a camera stream, saving the result to a file. For information about the plugins used in this pipeline, see Pipeline flow.

Application: gst-camera-rotate-downscale-file.py

Try me

Complete prerequisites

Ensure that you complete the Prerequisites.

Run the application

gst-camera-rotate-downscale-file.py

To display all available options:

gst-camera-rotate-downscale-file.py -h

Expected output

The output is saved to a file at /etc/media/test.mp4.

Pipeline flow

Plugin	Description
`qticamsrc`	Captures the video stream.
`qtivtransform`	Rotates and downscales the video stream.
`v4l2h264enc`	Encodes H.264 video.
`h264parse`	Parses the encoded H.264 video stream.
`mp4mux`	Multiplexes the stream into an MP4 container.
`filesink`	Writes the video data to a file.

Dynamic Camera Overlay Using Python

The gst-camera-overlay.py application demonstrates how to render dynamic text overlays on a live camera preview stream. The application injects overlay data into video buffers as ROI metadata and uses qtivoverlay to render text on the display. It supports runtime updates to overlay text, position, and color, and automatically selects the available camera. For information about the plugins used in this pipeline, see Pipeline flow.

Application: gst-camera-overlay.py

Try me

Complete prerequisites

Ensure that you complete the Prerequisites.

Run the application

gst-camera-overlay.py

To display all available options:

gst-camera-overlay.py -h

Expected output

Displays a live camera preview through waylandsink.

Pipeline flow

Pipeline	Description
Preview on display	`qtiqmmfsrc` (cam0 + cam1) → queue → `qtivoverlay` → `waylandsink`

Video and Audio Applications

Concurrent Video Playback (Video Wall) Using Python

The gst-concurrent-videoplay-composition.py application supports concurrent video playback for MP4 AVC (H.264) videos and performs composition on a video wall display. For information about the plugins used in this pipeline, see Pipeline flow.

Application: gst-concurrent-videoplay-composition.py

Try me

Complete prerequisites

Ensure that you complete the Prerequisites.

Run the application

gst-concurrent-videoplay-composition.py --infile /etc/media/video_avc.mp4

To change the number of sessions, update -c with 2, 4, 8, or 16.To display all available options:

gst-concurrent-videoplay-composition.py -h

Expected output

The individual composed streams are tiled together to display as a unified stream.

Pipeline flow

Plugin	Description
`filesrc`	Reads the video data.
`qtdemux`	Demultiplexes the video data.
`h264parse`	Parses H.264 video streams.
`v4l2h264dec`	Decodes H.264 video streams.
`qtivcomposer`	Composes decoded streams and sends to display.
`waylandsink`	Displays the video stream on the Wayland display.

Video Transformation Using OpenCV

The gst-opencv-transform.py application captures and transforms a video frame then displays the video on the screen using the OpenCV VideoCapture() function. For information about the plugins used in this pipeline, see Pipeline flow.

Application: gst-opencv-transform.py

Try me

Complete prerequisites

Ensure that you complete the Prerequisites.

Run the application

gst-opencv-transform.py --infile /etc/media/video_avc.mp4

To display all available options:

gst-opencv-transform.py -h

Expected output

The stream is displayed on the screen.

Pipeline flow

Plugin	Description
`filesrc`	Reads the video data.
`qtdemux`	Demultiplexes the video data.
`h264parse`	Parses H.264 video streams.
`v4l2h264dec`	Decodes H.264 video streams.
`qtivtransform`	Transforms the video data.
`videoconvert`	Converts video frames from one format to another.
`capsfilter`	Enforces constraints on the video data.
`waylandsink`	Displays the video stream on the Wayland display.

Troubleshooting

Model not available after running the download script?

Download the model manually from IoT — Qualcomm AI Hub and push it to the device:

scp <model filename> root@<IP addr of the target device>:/etc/models

Running sample applications from the UART shell

Remount the file system with read/write permissions:For Qualcomm Linux:

mount -o remount,rw /usr

For Ubuntu Server:

mount -o remount,rw /

Cannot locate the qticamsrc plugin?

ps -ef | grep cam-server
rm ~/.cache/gstreamer-1.0/registry.aarch64.bin

GStreamer logging and debugging

export GST_DEBUG=2
export GST_DEBUG=3,qticamsrc:5,qtimlvconverter:5,qtimltflite:5
export GST_DEBUG_FILE=/tmp/gst_debug.log

Getting Started

Building AI Pipelines

Examples

Reference

Plugins

Config 1: Supported Camera Slots by Platform

Prerequisites

Camera Applications

Camera Encoding

Expected output

Pipeline flow

Camera Streaming Using OpenCV

Expected output

Troubleshoot GTK backend failure in root mode

Pipeline flow

Multi-Camera Streaming Using Python

Expected output

Pipeline flow

Decode JPEG Images Using Python

Expected output

Pipeline flow

Transform and Encode a Camera Stream

Expected output

Pipeline flow

Dynamic Camera Overlay Using Python

Expected output

Pipeline flow

Video and Audio Applications

Concurrent Video Playback (Video Wall) Using Python

Expected output

Pipeline flow

Video Transformation Using OpenCV

Expected output

Pipeline flow

Troubleshooting

​Config 1: Supported Camera Slots by Platform

​Prerequisites

​Camera Applications

​Camera Encoding

​Expected output

Pipeline flow

​Camera Streaming Using OpenCV

​Expected output

​Troubleshoot GTK backend failure in root mode

Pipeline flow

​Multi-Camera Streaming Using Python

​Expected output

Pipeline flow

​Decode JPEG Images Using Python

​Expected output

Pipeline flow

​Transform and Encode a Camera Stream

​Expected output

Pipeline flow

​Dynamic Camera Overlay Using Python

​Expected output

Pipeline flow

​Video and Audio Applications

​Concurrent Video Playback (Video Wall) Using Python

​Expected output

Pipeline flow

​Video Transformation Using OpenCV

​Expected output

Pipeline flow

​Troubleshooting

Config 1: Supported Camera Slots by Platform

Prerequisites

Camera Applications

Camera Encoding

Expected output

Camera Streaming Using OpenCV

Expected output

Troubleshoot GTK backend failure in root mode

Multi-Camera Streaming Using Python

Expected output

Decode JPEG Images Using Python

Expected output

Transform and Encode a Camera Stream

Expected output

Dynamic Camera Overlay Using Python

Expected output

Video and Audio Applications

Concurrent Video Playback (Video Wall) Using Python

Expected output

Video Transformation Using OpenCV

Expected output

Troubleshooting