Open-Vocabulary Detection

Real-time text-prompt object detection via OWLv2 · no retraining required ·

OWLv2 Edge Modelowlv2-base-patch16Apache 2.0
~28 ms/frame (cached)·Cache 0/8 slots
Add Detection Prompt
Threshold in recommended range (0.15–0.60).
Quick-add
Active Prompts (0 / 8 cache slots)
Loading prompts…
How it works

Prompts are encoded by the OWLv2 text encoder (CLIP ViT-B/16) and cached by the edge node as a frozenset. Cached embeddings are reused across all subsequent frames — the text encoder runs only once per unique prompt set. The visual backbone processes every frame regardless.

After adding or removing prompts, click Push to Edge to sync via MQTT aiips/…/detection/custom-class/sync (QoS 1). The edge node acknowledges the update within the next heartbeat cycle (~5 s).

Detections are returned as { class_id: -1, class_name: <prompt>, detector: "owlv2" } and flow through the same alert pipeline as RF-DETR detections. The configured threat contribution is added to the Bayesian score at Layer 6.