Crowd-sourced Video In-sync
One such technology sneak peek was a unique synchronization of crowd-sourced video. Nicholas Bryan, an Adobe Creative Technology Labs intern, showed the audience how he could use a series of video clips shot at a concert to create a documentary of the whole concert with just the single click of an Analyze button.
The clips were from a Taylor Swift concert in San Jose, California, and each video was from a different angle and a variety of cameras, from stage-mounted cameras to handheld cell-phone video clips. All video footage included some view of Taylor Swift’s on-stage performance.
“If all the clips are viewed sequentially,” said Bryan, “it’s easy to see that some of the clips overlap each other, but by varying amounts.”
There weren’t enough clips overlapping to create a multi-camera option for on-demand content playback, but there were enough to fill in large gaps in the concert.
Using a command-line interface, Bryan’s pre-alpha software tool analyzed each video, looking for salient points in the video that were either unique or matched those in at least one of the other videos. In addition, the tool used the audio waveforms to match audio patterns between as many clips as possible.
The end result was a timeline that used all the clips, with corresponding clips overlapping each other and aligned in a completely audio/video-synchronized timing. While the video quality varied from clip to clip, the end result could easily be a crowd-sourced end-to-end video recording of the entire concert, comprised of tens or hundreds of clips from dozens of concertgoers.
“We see this as a breakthrough to allow news events, concerts, and other public events to be documented in a way not easily possible,” said Bryan, “and certainly not possible with today’s current editing and on-demand video tools.”