FlashRT

Bringing AI models into the physical world.

FlashRT is built for physical AI systems: robots, embodied agents, multimodal models, and the runtime paths that connect perception to action.

Showcase

Pick a scene. Watch a policy run it.

Real robot loops served on FlashRT, landing next week. Every tile opens a full scene.

Quick Start

Flash your pipeline.

Main repo

Build with the full FlashRT runtime.

import flash_rt

model = flash_rt.load_model(
    checkpoint="/path/to/checkpoint",
    framework="torch",    # or "jax"
    autotune=3,           # 0=off, 3=default, 5=thorough
)

actions = model.predict(
    images=[base_img, wrist_img],
    prompt="pick up the red block",
)
Scene

Make the model path physical.

From camera to motor in one runtime — a tight perception-to-action loop built for embodied systems.

Embodied intelligence

Perceive, reason and act, closed into a single low-latency path.

Low-latency interaction

Graph-replay execution holds every tick to a tight, predictable budget.

Multi-model system

Planner, world model and actor share one runtime, handing off by buffer.

Models

One runtime, every model class.

FlashRT runs the whole physical-AI stack — not just one family.

VLA

Vision-Language-Action

π0 · π0.5 · GR00T N1.x · OpenVLA

World

World models

Cosmos · Wan video diffusion · Motus

LLM

Language models

Qwen3 · Qwen3.6 · long-context agents

Speech

Speech & TTS

Streaming ASR ‖ VLA · text-to-speech

Policy

Diffusion policies

Flow / diffusion action heads, CFG rollout

Fusion

Multimodal

Image · video · proprioception fusion

Kernels

Hand-written kernels, pushed to the roofline.

A white-box C++ runtime of hand-tuned CUDA kernels — FP8 / NVFP4 quant and fused megakernels that beat vendor libraries on the shapes that matter.

1.4×
FP8 GEMM small-M
1.6×
NVFP4 GEMM
Kernelvs baseline
12×
RMSNorm+QKV
20×
FFN megakernel
30×
VAE FP4 conv
Fused kernelsvs baseline
12×
π0.5 policy
14×
Motus world model
End-to-endvs baseline
baseline FlashRT
Runtime

Runs where the robot runs.

One whole-graph runtime across data-center and edge silicon — what it covers today, and what's next.

Supported

NVIDIA

RTX 5090 · Thor · Orin

Supported

Edge devices

Jetson-class, low-power control loops

Coming soon

AMD

CDNA / RDNA, MI-class accelerators

Coming soon

More backends

Expanding the white-box kernel layer

Execution

Freeze the run. Restore it in a copy.

FlashRT manages state, not tokens.

2.08–5.72×TTFT on shared prefixes
± 0decode throughput unchanged
cos = 1.0restore is bit-exact to cold prefill
Read the idea