GRADUATE SCHOOL · Mixed reality
Splatroit is part of the Detro Tune Exhibiton. The Detro Tune exhibition is conceptualized as an audio-visual virtual voyage through music history, subcultural anatomy, and authentic Detroit city identity. To achieve such a unique experience, we expose the audience to multisensory stimuli powered by various media technologies such as virtual and mixed reality. This eternal Detroit placed in a timeless virtual space aims to immerse us into cultural habitus, which shaped a fruitful era of fresh and influential ideas and innovations.
Splatroit is an immersive mixed-reality game that intertwines Detroit's iconic techno music with its cityscape. The heart of this Mixed experience lies in the Monument to Joe Louis, 'The Fist,’ Which is Detroit's most popular symbol and location. Players can color and interact with 'The Fist' while enjoying Detroit's techno music. This symbolizes Detroit and the players becoming one. In the space surrounding the player, colorful balls and balloons envelop them. Within this setup, the player is immersed in a virtual environment of Detroit, where 'The Fist' is located. Outside this virtual realm, they can interact with the balls and balloons, experiencing a blend of mixed reality. As players engage with the pulsating techno rhythms, they dynamically color this emblematic landmark, creating a visual spectacle synchronized with the soundtrack. Splatroit embodies Detroit's spirit, allowing players to interact with its music and art.
ACHIEVEMENT
Splatroit is featured at the upcoming Detroit Month of Design and Ars Electronica events.
About My Role
Our team consisted of four members and collaborated well from the initial research to the testing. My particular role was prototyping using Unity and C#, and after launching this project at Ars Electronica and Detroit Month of Design, I mainly handled updating it with user feedback.
Splatroit: Detroit & Techno Music
Splatroit at Ars Electronica
Splatroit at Detroit Month of Design
DESIGN PROCESS
Goal
concept
[Concept sketch for the ideation]
IDEATE
1. In a white space with nothing, there is a white target object (a statue in the shape of a fist).
2. Techno music starts playing, and paintballs (red, blue, green) start rotating around the player, forming a circle.
3. The size of the paintballs increases and decreases according to the beat of the music.
4. When the player hits a paintball with a fist, the paintball flies in the direction in which it was hit.
Prototype
1. This is the first prototype. We materialized the storyboard from the initial ideate phase using Unity and C#.
2. For the Second prototype, We designed the environment around the monument to Joe Louis to resemble a more urban setting.
3. And in the third prototype, We expanded the originally confined space and brightened the atmosphere of the Scene.
4. In the fourth prototype, effects that synchronize with the light and music were introduced, aiming to elevate user immersion in the virtual space.
feedback loop
after launching
Users often asked me, 'Is there more?' and 'Is this the end?' while playing Splatroit, which hinted that achieving goals in Splatroit felt too easy for them. Therefore, I thought that increasing the difficulty of Splatroit and making the ball-grabbing action more enjoyable could be a solution. Consequently, I modified the code so the ball bounces when it hits the floor or buildings.
Previously, users sometimes played while standing in one place. The reason this is problematic is that Splatroit's intention was for users to enjoy Splatroit more by wandering around Spltroit and interacting with balloons and balls in reality, imprinting Detroit and Detroit techno music. I wanted to have the user move around and interact with the balls and balloons in the real world. So I added arrows to the bottom of the Splatroit scene to encourage user action to move around the space and interact with balls and balloons. As a result, the rate of users interacting with balls and balloons while moving around Splatroit increased by 60% compared to before, and users who enjoyed this process showed an increase in positive evaluations after experiencing Splatroit.
Originally, users were able to grab and throw the ball, but this was not intuitive and caused confusion. Instead, I modified it so that users can punch as soon as they grab the ball.
Despite initial explanations, some users were unclear on how to play Splatroit. Constantly asking how to play Splatroit can not only diminish players' interest but also exhaust those guiding the game. In the long run, this can lead to poor service and give a negative impression of Splatroit.. To mitigate this, I embedded a play guide directly within the Splatroit Scene to facilitate self-guided learning during gameplay. As a result, the frequency of user questions decreased by more than 80% compared to before.
[Before]
[after]
[after]
In Splatroit, when the ball flies too high in the sky, users cannot hit it. To prevent this, I modified the code to constrain the ball's flight within the bounds of the buildings.
mixed reality
result
different user experiences
between the ars electronica
and detroit month of design
[Ars Electronica]
[Detroit Month of Design]
Next step
What I've learned
1) I have acquired the ability to create a 3D environment using Unity and C#. I now have the ability to test users, gather feedback, and create projects in 3D environments as well as 2D environments like screens.
2) I realized that the initial prototype might not always be perfect. However, I learned that by quickly addressing failures and refining the solution based on user feedback, we can achieve a better outcome for the project.
3) Throughout the project, I considered a lot about how to convey the Splatroit through visuals, auditory, and tactile experiences and amplify its joy and value to people. This experience allowed me to go beyond screen-based user experiences, learning ways to create connections with users in environments where reality and virtuality converge. As a UX designer, this was an excellent opportunity to better understand user experiences and interactions.
