Darwin-preview-1.3B is open for testing
We’re making Darwin-preview-1.3B available for testing today. We’re looking for design partners, and we’re seeking feedback.
Darwin-preview-1.3B is a preview of our real-time video action-detection model. Point it at live video and it tells you what people are doing, as they do it — falling, climbing a ladder, opening a door, shaking hands. It’s built on a JEPA-based predictive world model: rather than classifying single frames in isolation, the model learns how scenes evolve over time and detects actions from that understanding of motion. That’s what lets it run against live streams instead of waiting for a clip to finish.
Preview means preview. Quality is improving rapidly, and you should expect occasional misses — an action detected a beat late, or not at all. The vocabulary below is what the model is currently trained to detect. We’d rather show you exactly where the edges are than pretend there aren’t any.
What Darwin-preview-1.3B can detect today
Darwin-preview-1.3B currently detects 532 action classes. Prompts targeting actions outside this list may produce unreliable results — if the product sent you here after a prompt warning, this list is why.
A
- abseiling
- acting in play
- adjusting glasses
- air drumming
- answering questions
- applauding
- applying cream
- archery
- arm wrestling
- arranging flowers
- assembling computer
- auctioning
B
- baby waking up
- baking cookies
- balloon blowing
- bandaging
- barbequing
- bartending
- base jumping
- bathing dog
- beatboxing
- bee keeping
- belly dancing
- bench pressing
- bending back
- bending metal
- biking through mud
- blasting sand
- blowing glass
- blowing leaves
- blowing nose
- blowing out candles
- bobsledding
- bookbinding
- bouncing on trampoline
- bowling
- braiding hair
- breading or breadcrumbing
- breakdancing
- brush painting
- brushing hair
- brushing teeth
- building cabinet
- building shed
- bungee jumping
- busking
C
- canoeing or kayaking
- capoeira
- carrying baby
- cartwheeling
- carving pumpkin
- catching fish
- catching or throwing baseball
- catching or throwing frisbee
- catching or throwing softball
- celebrating
- changing oil
- changing wheel
- checking tires
- cheerleading
- chopping wood
- clapping
- clay pottery making
- clean and jerk
- cleaning floor
- cleaning gutters
- cleaning pool
- cleaning shoes
- cleaning toilet
- cleaning windows
- climbing a rope
- climbing ladder
- climbing tree
- closing something
- contact juggling
- cooking chicken
- cooking egg
- cooking on campfire
- cooking sausages
- counting money
- country line dancing
- covering something
- cracking neck
- crawling baby
- crossing river
- crying
- curling hair
- cutting nails
- cutting pineapple
- cutting watermelon
D
- dancing ballet
- dancing charleston
- dancing gangnam style
- dancing macarena
- deadlifting
- decorating the christmas tree
- digging
- dining
- disc golfing
- diving cliff
- dodgeball
- doing aerobics
- doing laundry
- doing nails
- drawing
- dribbling basketball
- drinking
- drinking beer
- drinking shots
- driving car
- driving tractor
- drop kicking
- drumming fingers
- dunking basketball
- dying hair
E
- eating burger
- eating cake
- eating carrots
- eating chips
- eating doughnuts
- eating hotdog
- eating ice cream
- eating spaghetti
- eating watermelon
- egg hunting
- exercising arm
- exercising with an exercise ball
- extinguishing fire
F
- faceplanting
- feeding birds
- feeding fish
- feeding goats
- felling tree
- filling eyebrows
- finger snapping
- fixing hair
- flipping pancake
- fly tying
- flying kite
- folding clothes
- folding napkins
- folding paper
- folding something
- front raises
- frying vegetables
G
- gargling
- getting a haircut
- getting a tattoo
- giving or receiving award
- golf chipping
- golf driving
- golf putting
- grinding meat
- grooming dog
- grooming horse
- gymnastics tumbling
H
- hammer throw
- hand washing clothes
- head stand
- headbanging
- headbutting
- high jump
- high kick
- hitting baseball
- hockey stop
- holding something
- holding something in front of something
- holding something next to something
- holding something over something
- hoverboarding
- hugging
- hula hooping
- hurdling
- hurling sport
I
- ice climbing
- ice fishing
- ice skating
- ironing
- ironing clothes
J
- javelin throw
- jetskiing
- jogging
- juggling balls
- juggling fire
- juggling soccer ball
- jumping bicycle
- jumping into pool
- jumping jacks
- jumping sofa
- jumpstyle dancing
K
- kicking field goal
- kicking soccer ball
- kissing
- kitesurfing
- knitting
- krumping
L
- laughing
- laying bricks
- laying stone
- letting something roll down a surface
- licking
- lifting a surface with something on it
- lifting hat
- lifting something
- lifting something up completely
- lighting candle
- lighting fire
- lock picking
- long jump
- looking at phone
- lunge
M
- making a cake
- making a sandwich
- making bed
- making jewelry
- making pizza
- making snowman
- making sushi
- making tea
- marching
- massaging back
- massaging feet
- massaging legs
- massaging persons head
- milking cow
- mopping floor
- motorcycling
- moving child
- moving furniture
- moving something across a surface
- moving something away from something
- moving something closer to something
- moving something down
- moving something up
- mowing lawn
- mushroom foraging
N
- news anchoring
O
- opening bottle
- opening door
- opening present
- opening something
P
- packing
- paragliding
- parasailing
- parkour
- passing American football in game
- passing American football not in game
- peeling apple
- peeling banana
- peeling potatoes
- petting animal not cat
- petting cat
- picking fruit
- picking something up
- pillow fight
- pinching
- plastering
- playing accordion
- playing badminton
- playing bagpipes
- playing basketball
- playing bass guitar
- playing cards
- playing cello
- playing chess
- playing clarinet
- playing controller
- playing cricket
- playing cymbals
- playing didgeridoo
- playing drums
- playing flute
- playing guitar
- playing handball
- playing harmonica
- playing harp
- playing ice hockey
- playing keyboard
- playing kickball
- playing laser tag
- playing monopoly
- playing organ
- playing paintball
- playing piano
- playing poker
- playing recorder
- playing saxophone
- playing squash or racquetball
- playing tennis
- playing trombone
- playing trumpet
- playing ukulele
- playing violin
- playing volleyball
- playing xylophone
- plumbing
- poaching eggs
- poking something so it falls over
- poking something so it slightly moves
- pole vault
- polishing furniture
- polishing metal
- popping balloons
- pouring something into something
- pouring something onto something
- pretending to be a statue
- pretending to pick something up
- pretending to put something next to something
- pretending to take something from somewhere
- pretending to throw something
- pull ups
- pulling something from behind of something
- pulling something from left to right
- pulling something from right to left
- pulling something onto something
- pulling something out of something
- pulling two ends of something so that it gets stretched
- pumping fist
- pumping gas
- punching bag
- punching person boxing
- push up
- pushing car
- pushing something from left to right
- pushing something from right to left
- pushing something off of something
- pushing something onto something
- pushing something so it spins
- pushing something so that it almost falls off but doesnt
- pushing something so that it falls off the table
- pushing something with something
- pushing wheelchair
- putting makeup on someone
- putting on eyeliner
- putting on foundation
- putting on lipstick
- putting on mascara
- putting on shoes
- putting something and something on the table
- putting something behind something
- putting something in front of something
- putting something into something
- putting something next to something
- putting something on a flat surface without letting it roll
- putting something on a surface
- putting something on the edge of something so it is not supported and falls down
- putting something onto a slanted surface but it doesnt glide down
- putting something onto something
- putting something similar to other things that are already on the table
- putting something that cant roll onto a slanted surface so it slides down
- putting something underneath something
- putting something upright on the table
R
- reading book
- reading newspaper
- recording music
- removing something spreading it apart from something
- riding a bike
- riding camel
- riding elephant
- riding mechanical bull
- riding mountain bike
- riding mule
- riding or walking with horse
- riding scooter
- riding snow blower
- riding unicycle
- ripping paper
- robot dancing
- rock climbing
- rock scissors paper
- roller skating
- rolling eyes
- rolling pastry
- rolling something on a flat surface
- rope pushdown
- rowing boat
- running on treadmill
S
- sailing
- salsa dancing
- sanding floor
- scrambling eggs
- scuba diving
- setting table
- sewing
- shaking hands
- shaking head
- shaking something
- sharpening knives
- sharpening pencil
- shaving head
- shaving legs
- shearing sheep
- shooting basketball
- shooting goal soccer
- shopping
- shot put
- shoveling snow
- showing something behind something
- showing something next to something
- showing something on top of something
- showing something to the camera
- shredding paper
- shuffling cards
- side kick
- sign language interpreting
- singing
- situp
- skateboarding
- ski ballet
- ski jumping
- skiing crosscountry
- skiing mono
- skiing slalom
- skipping rope
- skipping stone
- skydiving
- slacklining
- slapping
- sled dog racing
- smoking
- smoking hookah
- snatch weight lifting
- sneezing
- sniffing
- snorkeling
- snowboarding
- snowkiting
- snowmobiling
- somersaulting
- spinning poi
- spinning something so it continues spinning
- spinning something that quickly stops spinning
- spraying
- springboard diving
- squat
- squeezing something
- stacking something
- stamping something
- standing on hands
- sticking something on something
- sticking tongue out
- stirring
- stomping grapes
- stretching arm
- stretching leg
- strumming guitar
- stuffing something into something
- surfing crowd
- surfing water
- sweeping floor
- swimming backstroke
- swimming breast stroke
- swimming butterfly stroke
- swing dancing
- swinging legs
- swinging on something
- sword fighting
- sword swallowing
T
- tackling football
- tai chi
- taking a shower
- taking photo
- taking something from somewhere
- taking something out of something
- tango dancing
- tap dancing
- tapping guitar
- tapping pen
- tasting beer
- tasting food
- tasting wine
- texting
- throwing axe
- throwing ball
- throwing discus
- throwing knife
- throwing something
- throwing something against something
- throwing something in the air and catching it
- throwing something in the air and letting it fall
- throwing something onto a surface
- tickling
- tipping something over
- tipping something with something in it over so everything falls out
- tobogganing
- tossing coin
- tossing salad
- training dog
- trapezing
- trimming or shaving beard
- trimming trees
- triple jump
- tumbling something downwards
- turning something upside down
- turning the camera left while filming something
- turning the camera right while filming something
- tying bow tie
- tying knot not on a+rope
- tying shoe laces
U
- uncovering something
- unfolding something
- using a power drill
- using a wrench
- using computer
- using remote controller not gaming
- using segway
V
- vault
- visiting museum
W
- walking the dog
- washing dishes
- washing feet
- washing hair
- washing hands
- water skiing
- water sliding
- watering plants
- waving hand
- waxing back
- waxing chest
- waxing eyebrows
- waxing legs
- weaving basket
- welding
- whistling
- windsurfing
- wiping something off of something
- wrapping present
- wrestling
- writing
Y
- yawning
- yoga
Z
- zumba
No matching actions. Prompts outside this vocabulary may produce unreliable results.
We’re looking for design partners
If you’re building on real-time video understanding — security, safety, retail, sports, robotics, manufacturing — we want to work with you directly while Darwin-preview-1.3B matures. Design partners get a direct line to the team and real influence over what the model learns to detect next.
And if you’re just testing: tell us what it misses and what surprises you. A prompt that should have worked, an action caught that you didn’t expect — that feedback is exactly what a preview is for.