I visited Sebastian and his father Finn for a talk about using eyetracking to interface computers and produce music. Really inspiring!
Sebastian uses a very advanced and accurate eyetracker by Tobii to control his Windows PC. He attends a special school where he learns to produce music, and has a full Pro Tools setup both at home and at school for music produciton
A key takeaway from my visit was that even though Sebastian masters his eyetracker to near perfection, he has found no software that allows him to play music in live or in real time in a satisfying way. The rhythm is almost impossible to get right, and no screenbased instruments seem designed to be controlled by eyetrackers, so Sebastian mainly produces drumbeats and mixes the compositions and lets his teachers in school record keyboard parts according to his instructions.
Subtitles to come…