Audio Classification

🟡 Float32 - Model Precision

Download Required Files

File	Save as
Model	yamnet_float.tflite
yamnet.json	yamnet.json
Sample video with FLAC audio (H.264 video + FLAC audio track in MP4 container)	H264_720p_30fps_FLAC.mp4

If any downloaded file is a .zip archive, extract it on your host machine before copying: unzip filename.zip

Copy Files to Device

# ~ resolves automatically to the correct home directory on the device (/root on QLI, /home/ubuntu on Ubuntu).

ssh <user>@<device-ip> "mkdir -p ~/{models,labels,media,media/output}"
scp yamnet_float.tflite        <user>@<device-ip>:~/models/
scp yamnet.json                <user>@<device-ip>:~/labels/
scp H264_720p_30fps_FLAC.mp4   <user>@<device-ip>:~/media/

Connect to device

# Run from your host machine — replace <user> and <device-ip>
ssh <user>@<device-ip>

Set Environment Variables

Qualcomm Linux

export MODEL_NAME=yamnet_float.tflite
export LABELS_NAME=yamnet.json
export SRC_VIDEO_NAME=H264_720p_30fps_FLAC.mp4

Run the Pipeline

gst-launch-1.0 -e filesrc location=~/media/$SRC_VIDEO_NAME ! qtdemux name=demux demux. ! queue ! h264parse ! \
v4l2h264dec capture-io-mode=4 output-io-mode=4 ! video/x-raw, format=NV12 ! qtivcomposer name=mixer sink_1::position="<50, 50>" sink_1::dimensions="<368, 64>" ! \
queue ! waylandsink fullscreen=true demux. ! queue ! flacparse ! flacdec ! queue ! audioconvert ! audioresample ! \
audiobuffersplit output-buffer-size=31200 ! queue ! qtimlaconverter  sample-rate=16000 feature=lmfe params="params,nfft=96,nhop=160,nmels=64,chunklen=0.96;" ! \
queue ! qtimltflite name=infeng model=~/models/$MODEL_NAME ! qtimlpostprocess settings="{\"confidence\": 10.0}" results=3 module=yamnet \
labels=~/labels/$LABELS_NAME ! video/x-raw,format=BGRA,width=368,height=64 ! queue ! mixer.

Overview

Supported AI Models

Plugins

Advanced Topics