Pegasus 1.6 by TwelveLabs

Really neat. How dependent is it on existing commercial models or is it enough of its own thing?

Any plans to host this on bedrock ?

Heard about TwelveLabs because of the ElevenLabs acronym, and love seeing it grow into such a mature, cool product!

This is amazing!

This is seriously impressive. What's next? What's on your roadmap for 1.7? Looking forward to your future launches

Turning raw teleoperation and wearable footage into labeled, timestamped robot training data solves a bottleneck that physical AI teams feel constantly, since collecting the video is easy and annotating it is not. Understanding first person perspective specifically is the right specialization. Do the persistent metadata labels stay consistent across long recording sessions?

Go pegasus1.6!

Do you think egocentric video could become one of the main data sources for training robots?Congrats @aiden_lee7 & team!Thanks for hunting @fmerian :)

had a blast collaborating with @c3lim and the @TwelveLabs team on this new launch.Pegasus 1.5 launched 6 months ago, with autonomous and reliable segmentation, long-form video support, and SOTA performances. Pegasus 1.6 pushes the model forward by adding support for first-person video, and faster processes, enabling new opportunities for robotics and physical AI teams. The community loved 1.5 (Top Product of the Day, featured in the daily newsletter), hope you'll enjoy 1.6!Follow @TwelveLabs for future launches (spoiler alert: soon)

Hi everyone, I'm Aiden, co-founder and CTO at TwelveLabs. Excited to share Pegasus 1.6 with you today.Every robotics and physical AI team we talk to is sitting on the same problem: hours of first-person footage that's the raw material for action labeling and next-action prediction, and no foundation model actually built to understand it. General-purpose video models are trained on broadcast and third-person footage. Point them at a wearable or a robot's own camera and they miss what's actually happening.Pegasus 1.6 is our answer. It's the first TwelveLabs model built for egocentric (first-person) video understanding. Pegasus 1.6 expands on Pegasus 1.5's Time-Based Metadata (TBM), which extracts timestamped, structured metadata from custom schemas, by adding support for egocentric video and task narration. We've also sharpened detailed recognition of hand, tool, and object interactions , while speeding up processing for high-volume video workloads. As an update to 1.5’s capabilities, we also have improved performance on in-depth metadata extraction and on grounded entity recognition, the ability to name a character based on context clues in the video.  Concretely, for robotics and data teams that means: point Pegasus at raw egocentric clips  and get back structured action labels, compliance ratings, and timestamps you can use directly in a training pipeline instead of a manual labeling pass that costs $4–$22/hour of footage.Physical AI is a new domain for us, so if you're working with egocentric (human or teleoperated) data and hit edge cases, I want to hear about them. Thanks!