Primate Vision vs. the Video-AI Landscape (2026)
Something strange happened to video AI in 2026, and as far as I can tell nobody has written it down: the managed real-time lane emptied out. AWS closed Rekognition streaming to new customers. Microsoft retired its live-camera analysis product. Google’s streaming video API has been in Beta since 2019, with release notes frozen since 2021. Sieve left the category entirely. What’s left is batch indexers, token-metered LLMs sampling one frame per second, and self-hosted build-it-yourself stacks.
Which leaves a claim I’ll spend this post earning: Primate Vision is the only managed, open-vocabulary, real-time video-analysis API operating at native frame rates. You ask a question in plain English. You get back a deterministic verdict — yes / no / indeterminate — with a 0–1 confidence score, timestamped evidence segments, and an annotated overlay clip, at 45ms p50 per-frame inference. Here’s the full map, with receipts.
The market-structure story: the real-time lane emptied
If you tried to buy managed real-time video analysis in 2024, you had options. In 2026, one by one, the vendors walked away:
- AWS Rekognition Streaming Video Events closed to new customers effective April 30, 2026. A new customer cannot buy real-time video analysis from Rekognition at all. AWS’s own published migration path: snapshot frames and call the image API via Lambda. (AWS availability changes) Even grandfathered accounts get only “people, packages and pets,” max 120 seconds per motion event — not continuous monitoring. (AWS docs)
- Microsoft retired Azure AI Vision Spatial Analysis (live-camera people counting and zone events) on March 30, 2025. (Microsoft Q&A) What remains — Azure Video Indexer — is an upload-and-index product; there is no live-stream API in 2026, despite legacy “stored or streaming” marketing on the pricing page. (Azure VI pricing, FAQ)
- Google Video Intelligence is frozen in maintenance mode — its release notes have no entries after November 1, 2021. (release notes) Its streaming mode has been Beta since 2019, is excluded from the SLA, and live protocols require compiling and operating Google’s AIStreamer C++/GStreamer proxy yourself. (live-streaming docs)
- Sieve exited the developer video-AI API business entirely. sievedata.com now redirects to sieve.ai — “The multimodal data lab” — selling training datasets to frontier labs. The docs, api, and dashboard subdomains no longer resolve in DNS. Sieve is excluded from the comparison below because there is no processing product left to compare. (DNS + site checks, 2026-07-31.)
- OpenAI is exiting video APIs, not entering. No OpenAI API accepts video input — not Responses, not Chat Completions, not Realtime (vision docs; open SDK request) — and the Sora 2 Videos API was deprecated March 24, 2026 with shutdown September 24, 2026. (deprecations)
Every qualifier in our claim is load-bearing, and I want to show the work: managed (NVIDIA VSS is genuinely real-time, but it’s a self-hosted blueprint — NVIDIA’s docs instruct you to provide your own authentication, TLS termination, and network isolation (NVIDIA VSS docs)); open-vocabulary (Roboflow sells managed real-time streams, but for fixed object nouns per frame — no temporal events, no verdicts); native frame rates (Gemini Live is managed and low-latency, but its video input is spec-capped at “images (JPEG <= 1FPS)” (Gemini Live docs) — Google’s own docs admit 1fps sampling misses fast action and recommend “slowing down such clips” as the workaround (video understanding docs)).
One more thing nobody else does: publish latency. This one genuinely surprised me. None of Twelve Labs, Google Video Intelligence, Gemini, AWS Rekognition, Azure Video Indexer, or OpenAI publishes end-to-end latency numbers for video analysis. Primate publishes 45ms p50 / 316ms p95 per-frame inference, 11.8 fps sustained, and 6.6s session setup on a public /performance page. (All vendor sources accessed 2026-07-31.)
What Primate Vision actually is
Primate Vision answers questions about video. That’s the whole product. You point it at a stream (managed WebRTC) or a file (upload or URL ingest, up to 2 GiB), ask a question in plain English — “Is anyone climbing the fence?” “Did the forklift enter the loading zone?” — and get:
- A deterministic verdict:
yes/no/indeterminate— a closed vocabulary, never free-form generation - A calibrated confidence score (0–1)
- Timestamped evidence segments showing exactly when
- An annotated overlay evidence video you can watch and share
Pricing is flat and legible: $0.01 per second of source video ($0.60/min), independent of frame rate — 10 seconds at 60fps bills as 10 seconds. Queued time is free. Failed jobs are free.
And what it isn’t. A comparison post you can’t audit is worthless, so here’s ours: Primate Vision does not return bounding-box JSON (evidence is the overlay video, not coordinates), does not offer embeddings or semantic search over archives, does not do transcription, OCR, or audio understanding (it’s visual-only), and does not batch-process multiple videos in one request (batch means up to 10 questions against one video, at 50% off each question after the first). If those are your primary needs, some of the products below are genuinely better choices — we say which ones.
The landscape in three tiers
Analyst charts classify by marketing category. I’d rather classify by what you can actually buy and run today:
Tier 1 — Managed, real-time, open-vocabulary, native frame rate
| Who | Why |
|---|---|
| Primate Vision | Managed WebRTC ingest, 45ms p50 per-frame inference, open-vocab question → verdict + timestamped evidence. The only entrant meeting all the criteria. |
Tier 2 — Near-real-time, constrained, or build-it-yourself
| Who | The constraint |
|---|---|
| Gemini Live API | Managed and conversational, but video input is hard-capped at ≤1fps JPEG stills and audio+video sessions are limited to 2 minutes without context compression (session docs). Real-time conversation, not real-time video analysis. And the meter compounds: Gemini Live re-bills the entire accumulated session context on every turn — “As a session lengthens, the cost per turn increases” (Google’s best-practices docs). |
| NVIDIA VSS blueprint | Genuinely real-time (RTSP first-class, GA), but 100% self-hosted: you supply GPUs, auth, TLS, Elasticsearch, and ops. A project, not a product. Its own release notes document that captions containing “yes”/“true” create spurious incident records (release notes). |
| Roboflow / Ultralytics | Managed streams with millisecond YOLO inference — best-in-class per-frame object detection. But open-vocab covers object nouns only; no temporal events, no verdicts, no “did X happen.” |
| Google VI streaming | Beta since 2019, SLA-excluded, DIY C++ proxy for live protocols. Effectively abandoned. |
| AWS Rekognition streaming | Closed to new customers; grandfathered accounts get people/pets/packages, ≤120s per event. |
| Self-hosted open VLMs (Qwen3-VL, InternVL, Moondream…) | Per-frame real-time is achievable and raw compute is very cheap — but no model ships a streaming layer. WebRTC/RTSP ingest, session state, structured output, and latency proof are all yours to build and operate. |
| OpenAI Realtime | GA and genuinely real-time — for audio and still images. No video track exists. |
Tier 3 — Batch / async only
| Who | The model |
|---|---|
| Twelve Labs | Upload → index → query. The best-funded pure-play in video understanding ($100M Series B, July 2026 — NEA + NAVER co-led, Amazon participating (announcement)), with excellent semantic search and the best agent-facing docs in the category. But there is no live ingestion of any kind in its docs — no WebRTC, RTSP, gRPC, or WebSocket input (upload methods). “Real-time” in their story means token-by-token text streaming and a partner integration. |
| Azure Video Indexer | Upload-and-index, rich audio+visual insights (transcription, OCR, faces). The strongest choice if your workload is media archive enrichment rather than visual question answering. |
| AWS Bedrock Nova | AWS’s designated forward path for video Q&A is explicitly offline: file/S3 only, all video resized to 672×672 “with distortion,” 1fps sampling only up to 16 minutes (a fixed 960-frame budget — a 1-hour video drops to 0.14fps), no audio (Nova docs). |
A note on keeping Google straight: Google sells two entirely different video surfaces and they must not be conflated. Google Video Intelligence is the 2017-era per-feature annotation API — fixed label taxonomies, no prompting anywhere, frozen release notes, and a pricing page that still lists Celebrity Recognition, a feature Google shut down in September 2025 (pricing, deprecations). Gemini is the modern surface — genuinely strong open-vocabulary video understanding for stored files, with the live-input constraints described above. When we say “Google’s video API is abandoned,” we mean GVI; when we say “1fps stills,” we mean Gemini Live. Different products, different criticisms.
Capability snapshot
Across ten providers, here’s where the capabilities actually sit. Including the three where competitors beat us outright — I’d rather print those myself than have you find them later:
- Live stream input. Primate Vision is the only managed, native-frame-rate path (WebRTC). NVIDIA VSS does it well — self-hosted. Roboflow streams live, for object detection only. Gemini Live accepts ≤1fps JPEG stills. Google VI streaming is Beta with a DIY C++ proxy. AWS streaming is closed to new customers. Twelve Labs, Azure Video Indexer, and OpenAI have no live video input at all.
- Published real-time latency. Primate publishes 45ms p50 / 316ms p95. Roboflow publishes per-frame YOLO numbers; NVIDIA publishes hardware-dependent benchmarks. Nobody else in the landscape publishes any latency number for video analysis.
- Open-vocabulary natural-language prompting. Primate Vision, Twelve Labs, Gemini, NVIDIA VSS, and open VLMs all take plain-English prompts (OpenAI on still images only). Roboflow’s open-vocab covers object nouns only. Google VI and AWS Rekognition have no prompting anywhere.
- Deterministic verdict + calibrated confidence. Primate Vision alone returns a closed-vocabulary yes / no / indeterminate with a calibrated 0–1 score. Twelve Labs’ JSON-schema output approximates the shape but is generative and uncalibrated; every LLM-based alternative is stochastic.
- Timestamped segments. Widely available — Primate, Twelve Labs, Gemini, Google VI, AWS, Azure, and NVIDIA all deliver them. OpenAI and Roboflow don’t.
- Evidence clips / overlay video. Primate ships an annotated overlay evidence video you can watch and forward. AWS streaming returns a single first-detection frame JPEG; most others return nothing watchable.
- Bounding-box JSON. We don’t do it — and Google VI, AWS Rekognition, Roboflow, and NVIDIA VSS all deliver frame-accurate spatial JSON. If you need coordinates for downstream geometry, they beat us outright.
- Embeddings / semantic search. We have none. Twelve Labs is the category flagship; Gemini, NVIDIA VSS, and Roboflow ship it too.
- Transcription / OCR / audio. We’re visual-only. Azure Video Indexer’s core strength; Twelve Labs and Gemini are also strong here.
- Webhooks. Primate (Standard Webhooks signing, retries, redelivery, plus
Prefer: wait), Twelve Labs, Gemini, AWS, Azure, and Roboflow: yes. Google VI: no. NVIDIA VSS: message-broker integration, not developer-facing webhooks.
Read the bounding-box, embeddings, and transcription bullets honestly: those are the three capabilities where several competitors beat us outright. If you need frame-accurate spatial JSON, Google VI, AWS Rekognition, Roboflow, and NVIDIA VSS all deliver it and we don’t. If you need semantic search over a large archive, Twelve Labs is the category leader. If you need transcription and OCR, Azure Video Indexer and Gemini are built for it.
Pricing: two lanes, and the honest math
Primate Vision has two pricing lanes, and every comparison in this library states both:
- Metered — $0.01/second of source video. For on-demand analysis: clips, incidents, agent-invoked checks, dev/test, bursty workloads. Flat and fps-independent. Queued time free; failed jobs free. A 30-second clip answered with a verdict, confidence, timestamps, and an evidence video costs $0.30.
- Enterprise — contact us. For 24/7 continuous monitoring and camera fleets: dedicated capacity or on-site deployment, priced at a small fraction of the metered rate under highly discounted enterprise plans. The metered price is deliberately not the continuous-monitoring price.
Here’s the normalized table, cheapest to most expensive — including the number our competitors would quote against us, because hiding it would be dishonest:
| Provider | Billing model | $/camera-hour @1fps (normalized) | Key gotcha |
|---|---|---|---|
| Self-hosted open VLMs | GPU rental + free weights | $0.03–$0.15 estimate | Assumes 100% utilization + free engineers; realistically ~0.5–1 FTE of MLOps is hidden in this number |
| AWS Bedrock Nova (Lite) | per-token, offline only | ~$0.06 estimate | 1fps only ≤16 min; 672×672 distortion; no audio; no live input |
| Gemini (Flash-Lite → Flash) | per-token | $0.28–$1.39 estimate, input-only | Live re-bills entire session context every turn — compounding cost curve |
| NVIDIA VSS | infra + per-GPU license | ~$0.3–$1.4 estimate at fleet utilization | High fixed cost; ~$14–22/hr box cost at single-stream utilization |
| AWS Rekognition streaming | per-minute streamed | $0.49 | Grandfathered accounts only; people/pets/packages; ≤120s/event |
| Twelve Labs | per-min index + monthly infra + per-query | $1.75–$2.52 estimate | Perpetual $0.0015/min-month fee: a 10,000-hour archive costs $900/month just to stay searchable (pricing) |
| OpenAI (frame workaround) | per-token | $1.84–$6.62 estimate | No video API — DIY frame pipeline; 1,500-image cap ≈ 25 min per request |
| Azure Video Indexer | per input-minute, meters stack | $2.70–$11.40 | Audio + video meters stack; re-index re-bills |
| Roboflow | subscription + credits | $3.00–$8.00 managed | Credits burn even on self-hosted inference |
| Google Video Intelligence | per-feature × per-minute | $6.00–$7.20 per feature | Partial minutes round UP: 1,000 five-second clips bill as 1,000 minutes (pricing) |
| Primate Vision — metered | per-second, flat | $36.00 † | See footnote — this is the on-demand lane, not the fleet price |
| Primate Vision — enterprise | contact us | a small fraction of the metered rate | 24/7 / fleet lane; dedicated capacity or on-site deployment |
† Metered rate normalized for comparison. Primate does not sell 24/7 continuous monitoring at the metered rate — continuous and fleet workloads use enterprise plans; contact us. Our own pricing page states the arithmetic plainly: a nonstop 30-day stream would be $25,920/month at self-serve rates, which is exactly why that workload belongs on an enterprise agreement.
Three things to hold in mind when reading any $/camera-hour table in this category:
- Per-verdict is the metered lane’s real unit. You don’t buy camera-hours on the metered lane; you buy answered questions. A 30-second incident clip → verdict + confidence + timestamped evidence = $0.30. Compare that to what a false alarm costs your ops team.
- Like-for-like fidelity changes the math. The cheap rows sample ~1fps. At 12fps parity, Gemini’s input tokens alone reach $0.28–$0.37/min — 46–62% of Primate’s all-in $0.60/min — with no verdict layer, no calibration, and no evidence artifacts on top.
- Raw price ≠ delivered capability. Every row cheaper than us is a raw-annotation or raw-token price. What the buyer still has to build on top — structured output contracts, a streaming layer, evidence generation, confidence calibration — is the actual cost of ownership.
Who should choose whom
These are genuine recommendations, not straw men. Half of them point away from us.
- Choose Twelve Labs if your core need is semantic search over a large stored-video archive. It’s the category leader there, well-funded, with excellent agent-facing docs. It cannot watch anything live. (Full comparison →)
- Choose Gemini for conversational understanding of stored video files at low cost — genuinely strong. Know the live path is ≤1fps stills with 2-minute A/V sessions and a compounding per-turn meter. (Full comparison →)
- Choose Azure Video Indexer for media-archive enrichment: transcription, OCR, faces, translation. It’s an indexer, not an analyst. (Full comparison →)
- Choose Google VI only if you need its specific GA annotations (label detection, explicit-content, OCR) with an SLA and can live with a product frozen since 2021. (Full comparison →)
- Choose AWS Rekognition if you’re already grandfathered into streaming events for people/pets/packages, or need its GA bounding-box JSON on stored video. New real-time customers: AWS itself has closed the door. (Full comparison →)
- Choose NVIDIA VSS if you have GPUs, an infra team, and an air-gap requirement — it’s the strongest self-hosted real-time stack, at the cost of owning all of it. (Full comparison →)
- Choose Roboflow/Ultralytics for millisecond per-frame object detection, custom-trained models, and edge deployment. It does not answer “did X happen.” (Full comparison →)
- Choose self-hosted open VLMs if raw unit cost dominates everything, you have MLOps capacity, and you’re prepared to build ingest, streaming, structured output, and evaluation yourself. (Full comparison →)
- Choose OpenAI for still-image and document reasoning — the best there is. It sells no video input path in any API. (Full comparison →)
- Choose Primate Vision when you need a managed API that watches video — live or uploaded — and returns a deterministic, auditable answer: yes / no / indeterminate, a confidence score, timestamps, and evidence you can watch. That lane, in 2026, is ours alone.
The deep dives
Each head-to-head gets its own full post, with per-claim citations to the vendor’s live documentation:
- Primate Vision vs. Twelve Labs — real-time verdicts vs. archive search
- Primate Vision vs. Gemini — 1fps stills vs. native frame rate
- Primate Vision vs. NVIDIA VSS — a managed API vs. a build-it-yourself blueprint
- Primate Vision vs. AWS Rekognition + Bedrock Nova — the door AWS closed
- Primate Vision vs. Roboflow / Ultralytics — detections vs. verdicts
- Primate Vision vs. OpenAI — a video API vs. a frame-extraction workaround
- Primate Vision vs. Azure Video Indexer — an insight catalog vs. a live answer
- Primate Vision vs. Google Video Intelligence — any question you can type vs. a label menu frozen in 2021
- Primate Vision vs. Sieve — the video API that quietly left the market
- Primate Vision vs. self-hosted open VLMs — buying answers vs. building a video pipeline
Try it
Try it for free — real processing, no card required to start.
Your AI agent can do it for you — right from Claude. Primate Vision ships an MCP server, llms.txt, markdown docs twins, and a sandbox key available in a single POST — your agent can get a key, upload a clip, and read back a verdict without a human touching a dashboard.
For 24/7 monitoring and camera fleets: see our enterprise plans.
Method note: every competitor claim in this post traces to a primary source — vendor docs, pricing pages, release notes — accessed 2026-07-31. Estimates are labeled. An earlier April 2026 version of this analysis was re-verified from scratch; anything that couldn’t be re-verified was dropped.