CrowdSourced Technology update – Adobe working on video synchronization technology to automatically sync multiple streams


Crowd-sourced Video In-sync

One such technology sneak peek was a unique synchronization of crowd-sourced video. Nicholas Bryan, an Adobe Creative Technology Labs intern, showed the audience how he could use a series of video clips shot at a concert to create a documentary of the whole concert with just the single click of an Analyze button.

The clips were from a Taylor Swift concert in San Jose, California, and each video was from a different angle and a variety of cameras, from stage-mounted cameras to handheld cell-phone video clips. All video footage included some view of Taylor Swift’s on-stage performance.

“If all the clips are viewed sequentially,” said Bryan, “it’s easy to see that some of the clips overlap each other, but by varying amounts.”

There weren’t enough clips overlapping to create a multi-camera option for on-demand content playback, but there were enough to fill in large gaps in the concert.

Using a command-line interface, Bryan’s pre-alpha software tool analyzed each video, looking for salient points in the video that were either unique or matched those in at least one of the other videos. In addition, the tool used the audio waveforms to match audio patterns between as many clips as possible.

The end result was a timeline that used all the clips, with corresponding clips overlapping each other and aligned in a completely audio/video-synchronized timing. While the video quality varied from clip to clip, the end result could easily be a crowd-sourced end-to-end video recording of the entire concert, comprised of tens or hundreds of clips from dozens of concertgoers.

“We see this as a breakthrough to allow news events, concerts, and other public events to be documented in a way not easily possible,” said Bryan, “and certainly not possible with today’s current editing and on-demand video tools.”

Advertisements
  1. Leave a comment

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: