D J T a b l e

a collaborative music experience for useless millennials who can’t actually play music.

Demo

Welcome to the Demo of the crazy collaborative music experience,DJTable. Play the video and have fun.

Working Process

Goals and Motivation

The goal of DJTable is to make a collaborative tabletop music experience for users through soothing music and synesthetic visual graphics.

Music has been proposed as psychological support for patients with low- and medium-grade depression. Therefore, the motivation of DJTable is to enable music creation even for people who cannot play any instruments.

Graphics

DJTable is an abstract themed experience. The graphics are consist of two parts:

a) Each physical object on the table has its visual effects. A dial circle is shown that represents four different tracks of an instrument. At a specific distance between two or several objects, an exploding effect is shown which represents the fifth track.

b) A standalone space-themed visual experience is presented for the audience. The visual integrates with the music and creates pleasing visual experience.

Interaction

The interaction with the tabletop is done through physical objects, i.e. fiducials. Each of the fiducials represents a specific instrument. A trackable tag is attached underneath.

3D Models

To create a representation of each instrument, 3D physical objects are printed. The final shape of these physical objects was decided according to the result of a survey that was posted on AGI19 Facebook group.

Technologies

unity fmod blender pixel ableton

Challenges and Lessons Learned

One of the main challenges with DJTable was the requirement to use the deprecated Surface SDK 2.0, as it was the only way to communicate with the hardware and retrieve user input. Last updated in 2012 and compatible only with Windows 8, we had to find a way to integrate it with a modern Unity application. While Surface SDK does run on .NET, Unity uses a cross-platform .NET equivalent called Mono, which does not implement all .NET features that are needed for the Surface SDK APIs to be used directly from a Unity application. This is why we decoupled the input logic into a separate .NET listener app that reads the user input via Surface SDK and sends it forward in a stream of UDP packets, available both for our main Unity app to listen to locally, and for our external visualisation software that receives them through the network.

Photo gallery

Hello world demo, Photo: Mario Romero, license: CC1 Final testing before Forskar Fredag, Photo: Mario Romero, license: CC1 First successful 3D knob, Photo: Nahida Islam, license: CC0 Inspiring high school student (Forskar Fredag), Photo: Tingyi Li, license: CC0 Mistakes are okay, Photo: Nahida Islam, license: CC0 Enjoying the music (Forskar Fredag), Photo: Tingi Li, license: CC0 Inspiring each other (Forskar Fredag), Photo: Tingyi Li, license: CC0 Curious minds, Photo: Nahida Islam, license: CC0 Amazing crowd at Tekniska museet, Photo: Nahida Islam, license: CC0 Children having fun with the visual experience (Tekniska Museet), Photo: Nahida Islam, license: CC0 Building tower with fiducials? (Tekniska Museet), Photo: Nahida Islam, license: CC0 Little knob, Photo: Nahida Islam, license: CC0

Meet the team

profile-pricture

Arturs Kurzemnieks

Arturs' main focus was surface interactions. Implemented communications, handling of the surface inputs and the event system to be used in-game. Additionally worked on parts of the surface visualizations, creating instrument UI and background visuals.

profile-pricture

Augustin Bariant

The main task of Augustin was to work on the audio tracks effects and synchronization. He has also been working on how music supposed to react with user interaction. The technologies Augustin used for his tasks is Unity3D and fmod.

profile-pricture

Miguel Alvarez Bordils

Miguel, the music composer, composed the sound of each instrument and tracks, using Ableton. Each instrument has four different sound at this moment. He also made graphics for the standalone screen to let the audience enjoy the music with some graphics.

profile-pricture

Nahida Islam

Nahida has focused on modeling the 3D physical objects. She has also engaged in creating particle systems and implementing distance-based effects. Additionally, she developed this project website.
She was also the project manager.

profile-pricture

Tingyi Li

In the beginning of the project Tingyi worked with graphics for the table. She also worked briefly on intergrating visuals to the physical objects. Later on, she helped other things, such as poster making.