TFLite(LiteRT) - Generative AI on Genio 520

This page lists the generative AI models and representative performance data for Genio 520 platforms. For background information about generative workloads and usage notes, refer to TFLite(LiteRT) - Generative AI.

Model Support and Performance

Note

Performance numbers apply to both Android and Yocto (this platform supports both OS). For OS-level GAI support across all platforms, see AI Supporting Scope.

The following symbols are used in the tables below:

  • -- : To be released.

  • Q3/E : Support planned for Q3 end, 2026.

  • Q4/E : Support planned for Q4 end, 2026.

  • X : Platform does not support this model.

Large Language Models (LLMs)

Performance Comparison (Prompt/Generative) (Unit: tok/s)

Model

Genio 520

Qwen3-0.6B

526.43 / 23.04

Qwen3-1.7B

258.83 / 13.72

Qwen3-4B

126.12 / 7.30

Qwen3-8B

79.95 / 4.77

Qwen2.5-1.5B-Instruct

340.29 / 18.99

Qwen2.5-3B-Instruct

161.19 / 10.38

Qwen2.5-7B-Instruct

69.71 / 4.86

gemma3-1B (Text Only)

598.27 / 27.23

gemma3-4B (Text-Only)

176.90 / 5.90

llama3.2-1B-Instruct

385.77 / 24.76

llama3.2-3B-Instruct

153.84 / 10.26

Phi-3-mini-4k-instruct

126.82 / 7.26

Phi-3.5-mini-instruct

136.84 / 6.09

Vision-Language Models (VLMs)

Performance Comparison (ViT Inference Time / Prompt / Generative)

Model

ViT Inference Time (s)

Prompt Mode (tok/s)

Generative Mode (tok/s)

Qwen3VL-2B

0.42

124.25

13.7964

Speech Recognition Models (ASR)

Performance Data

Model

Genio 520

Whisper-base (8w16a)

Q3/E

Qwen3-ASR-0.6B

–

Moonshine-Tiny

–

Measured latency for these models is reported in asr_cmdline_tool, together with the transcripts each package’s sample clip is expected to produce.

Android-only Models

The following model categories are supported on Android only and are not available on Yocto.

Note

Yocto support for these model categories is planned for 2026/E (estimated).

Stable Diffusion and Image Generation

Performance Comparison (Main Time/Inference Time) (Unit: ms)

Model

Genio 520

Stable Diffusion v2.1 base model with controlnet

35480 / 30421

Stable Diffusion v.1.5 controlnet

34483 / 33057

CLIP and Embedding Models

Performance Comparison (Main Time/Inference Time) (Unit: ms)

Model

Genio 520

img_encoder_proj_clip_vit_large_dynamic

488.69 / 314.31

img_encoder_proj_openclip_vit_h_dynamic

1376.49 / 1023.27

text_encoder_clip_vit_large

366.14 / 44.80

text_encoder_openclip_vit_h

679.66 / 128.66