PSPNet: Optimized for Qualcomm Devices

PSPNet (Pyramid Scene Parsing Network) is a semantic segmentation model that captures global context information by applying pyramid pooling modules. It is designed to improve scene understanding by aggregating contextual features at multiple scales.

This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.42, ONNX Runtime 1.24.3 Download
ONNX w8a8 Universal QAIRT 2.42, ONNX Runtime 1.24.3 Download
QNN_DLC float Universal QAIRT 2.45 Download
QNN_DLC w8a8 Universal QAIRT 2.45 Download
TFLITE float Universal QAIRT 2.45 Download
TFLITE w8a8 Universal QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit PSPNet on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for PSPNet on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.semantic_segmentation

Model Stats:

  • Model checkpoint: pspnet101_ade20k.pth
  • Input resolution: 1x3x473x473
  • Number of parameters: 65.7M
  • Model size (float): 251 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
PSPNet ONNX float Snapdragon® 8 Elite Gen 5 Mobile 323.183 ms 239 - 1007 MB NPU
PSPNet ONNX float Snapdragon® X2 Elite 429.565 ms 266 - 266 MB NPU
PSPNet ONNX float Snapdragon® X Elite 695.088 ms 529 - 529 MB NPU
PSPNet ONNX float Snapdragon® 8 Gen 3 Mobile 505.529 ms 148 - 1065 MB NPU
PSPNet ONNX float Qualcomm® QCS8550 (Proxy) 604.578 ms 0 - 680 MB NPU
PSPNet ONNX float Qualcomm® QCS9075 1758.419 ms 78 - 84 MB NPU
PSPNet ONNX float Snapdragon® 8 Elite For Galaxy Mobile 333.069 ms 245 - 1002 MB NPU
PSPNet ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 17.157 ms 72 - 342 MB NPU
PSPNet ONNX w8a8 Snapdragon® X2 Elite 15.122 ms 131 - 131 MB NPU
PSPNet ONNX w8a8 Snapdragon® X Elite 28.639 ms 133 - 133 MB NPU
PSPNet ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 21.995 ms 72 - 492 MB NPU
PSPNet ONNX w8a8 Qualcomm® QCS6490 3430.903 ms 204 - 283 MB CPU
PSPNet ONNX w8a8 Qualcomm® QCS8550 (Proxy) 30.172 ms 64 - 147 MB NPU
PSPNet ONNX w8a8 Qualcomm® QCS9075 34.249 ms 70 - 74 MB NPU
PSPNet ONNX w8a8 Qualcomm® QCM6690 3282.281 ms 53 - 64 MB CPU
PSPNet ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 19.141 ms 72 - 343 MB NPU
PSPNet ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 2610.165 ms 64 - 76 MB CPU
PSPNet QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 273.571 ms 2 - 748 MB NPU
PSPNet QNN_DLC float Snapdragon® X2 Elite 226.869 ms 3 - 3 MB NPU
PSPNet QNN_DLC float Snapdragon® X Elite 528.761 ms 3 - 3 MB NPU
PSPNet QNN_DLC float Snapdragon® 8 Gen 3 Mobile 405.017 ms 3 - 949 MB NPU
PSPNet QNN_DLC float Qualcomm® QCS8275 (Proxy) 1332.704 ms 1 - 725 MB NPU
PSPNet QNN_DLC float Qualcomm® QCS8550 (Proxy) 591.416 ms 0 - 30 MB NPU
PSPNet QNN_DLC float Qualcomm® QCS9075 1757.657 ms 3 - 135 MB NPU
PSPNet QNN_DLC float Qualcomm® QCS8450 (Proxy) 1702.243 ms 0 - 441 MB NPU
PSPNet QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 303.338 ms 0 - 725 MB NPU
PSPNet QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 15.483 ms 1 - 310 MB NPU
PSPNet QNN_DLC w8a8 Snapdragon® X2 Elite 14.261 ms 1 - 1 MB NPU
PSPNet QNN_DLC w8a8 Snapdragon® X Elite 26.186 ms 1 - 1 MB NPU
PSPNet QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 20.88 ms 0 - 354 MB NPU
PSPNet QNN_DLC w8a8 Qualcomm® QCS8275 (Proxy) 63.863 ms 1 - 259 MB NPU
PSPNet QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 28.233 ms 0 - 26 MB NPU
PSPNet QNN_DLC w8a8 Qualcomm® QCS9075 31.798 ms 1 - 35 MB NPU
PSPNet QNN_DLC w8a8 Qualcomm® QCS8450 (Proxy) 37.703 ms 1 - 352 MB NPU
PSPNet QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 17.902 ms 1 - 232 MB NPU
PSPNet QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 90.562 ms 1 - 446 MB NPU
PSPNet TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 324.12 ms 128 - 961 MB NPU
PSPNet TFLITE float Snapdragon® 8 Gen 3 Mobile 514.959 ms 126 - 1257 MB NPU
PSPNet TFLITE float Qualcomm® QCS8275 (Proxy) 1686.092 ms 109 - 949 MB NPU
PSPNet TFLITE float Qualcomm® QCS8550 (Proxy) 598.496 ms 120 - 122 MB NPU
PSPNet TFLITE float Qualcomm® QCS9075 1766.366 ms 0 - 271 MB NPU
PSPNet TFLITE float Qualcomm® QCS8450 (Proxy) 1583.889 ms 90 - 688 MB NPU
PSPNet TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 988.643 ms 64 - 878 MB NPU
PSPNet TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 15.507 ms 32 - 316 MB NPU
PSPNet TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 22.064 ms 30 - 410 MB NPU
PSPNet TFLITE w8a8 Qualcomm® QCS8275 (Proxy) 66.601 ms 32 - 301 MB NPU
PSPNet TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 29.723 ms 32 - 35 MB NPU
PSPNet TFLITE w8a8 Qualcomm® QCS9075 32.525 ms 32 - 131 MB NPU
PSPNet TFLITE w8a8 Qualcomm® QCS8450 (Proxy) 41.239 ms 32 - 411 MB NPU
PSPNet TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 18.707 ms 32 - 284 MB NPU
PSPNet TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 106.468 ms 32 - 426 MB NPU

License

  • The license for the original implementation of PSPNet can be found here.

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support