An algorithm watching a movie trailer

What happens when an object detection algorithm watches a movie trailer?


An algorithm watching a movie trailer is a project by Lasse Korsgaard and Andreas Refsgaard from the creative coding studio Støj, that tries to explore how an object detection algorithm experiences a movie trailer.

Object detection is the process of identifying specific objects such as persons, cars and chairs in digital images or video. For most humans this task requires little effort regardless of how the objects may vary in different sizes, scales and rotations or whether they are partially obstructed from view. For long these tasks have been difficult for computers to solve, but recent developments have shown impressive improvements in accuracy and speed, even while detecting multiple objects in the same image.

We wondered what a fast paced movie trailer would look like seen through the lens of an object detection algorithm. Therefore we sent all individual frames from the movie trailer for The Wolf of Wall Street are through Yolo-2 with a threshold of 0.15, meaning that it only reacts to objects detected with a confidence of 15% or higher.

The project is built in openFrameworks using ofxDarknet.

My role

My role in this project involved ideation & coding. It was done in collaboration with Lasse Korsgaard as an exploration for our joint project Støj.