This tutorial on building a Unity VR project from scratch was created for the Master Media Media, HEAD – Genève.

Unity is the name of the 1977 album by the curious jazzman from the planet Saturn, Sun Ra and his Jet Set Omniverse Arkestra. It is also the name of the unreleased psychadelic GameCube title built in 2004 by the cult game creator Jeff Minter. It is also the name of the most popular engine for creating video games.

This tutorial is available on both on the abstractmachine website tutorials and the abstractmachine GitHub repository.

Game Engine

Unity is a “game engine”, used for making 2D, 3D, augmented reality, and virtual reality games — as well as interactive experiences in general. Its closest competitors are Unreal Engine, and the more modest open-source project Godot.

Game engines are tools and/or collections of code that have been designed to make it easier to make a game than to code it on your own from scratch. Game engines have already solved all the technical basics necessary for importing and manipulating images, 3D models, animations, rigs, textures, materials, sounds, and other assets that make up your game. Game engines also solve the problem of how to develop the behavior and logic of the game, often by implementing various code-based and visual-based scripting solutions for the interactive behavior and storytelling aspects of a game. They also make it easier to prepare your game for complex world distributing your games via all the various App Stores.

While a game engine requires you to learn the engine itself, it shields you from much of the hassle of learning development on all the myriad platforms where you would like to install your game. Here, for example, are some of the platforms where you can deploy/distribute a game made with Unity:

As you can see, the list is long and probably inclused some platforms you’ve never heard of. So the idea is that instead of having to learn each and every one of these platforms, all you need to make your game is to learn Unity and the tool will take care of the rest.

Get Started

Below I have listed some examples. If you want to jump directly into working with Unity and VR, you can skip this section and move directly to installing Unity.

Examples

The list of games made with Unity is almost infinite. Here are a few Unity showreels of games made with the tool, as well as the trailers for a few of the more famous games made with this tool.

Unity GDC 2021 Showcase

Unity AR & VR Games Showreel 2019

Unity GDC 2016 Showreel

Beat Saber

Superhot

Return of the Obra Dinn

Firewatch

Monument Valley

Inside

Cuphead

Far: Lone Sails

Sayonara Wild Hearts

Kids

Night In The Woods

Donut County

Reigns

Untitled Goose Game

World of Yoho

Oniri Islands

Virtual Reality

Virtual reality as a concept is an old dream, and like most of the other contempory computer interfaces we use today, Ivan Sutherland built a prototype of it in the 1960s, entitled The Sword of Damocles.

There have been many iterations in between The Sword of Damocles and the Oculus Quest, with an important stop in the 1980s and VPL Research, as seen here via the 1992 oddity Lawnmower Man where you will also see their other famous invention, the “data glove”:

We should also cite Char Davis’ 1995 installation/experience Osmose which was the first immersive experience that gave us a fuller sense of what virtual reality could be as an fully-integrated, functioning poetic experience:

But the artist that has truly shown us the way of virtual reality (both with and without headsets), as well as augmented reality, and a whole bunch of other realities that still have yet to be fully understood is Jeffrey Shaw. If ever there was a successor to the throne of Ivan Sutherland, it would be Jeffrey Shaw. Do yourself a favor and learn everything you can about Jeffrey Shaw and his work:

Since these early experiments, there have been many headsets, many failures, and many iterations of fully immersive virtual reality. The most famous, and yet brilliant, failure to making a virtual reality headset was Gunpei Yokoi’s Virtual Boy system:

Oculus

Around 2010, a duct-tape demo named the “Oculus Rift” started making the rounds that integrated a lot of these earlier ideas into a smaller, potentially commercializable package.

Long story short, Facebook quickly bought up Oculus and their prototype, the founder Palmer Luckey transformed himself into both a barefoot VR dork meme as well as a pro-Trump troll factory financeer — oh yeah and Mark Zuckerberg high-fived the avatar of his colleague Rachel Franklin inside of a live virtual reality feed of Puerto Rica and the distaster left behind by Hurricane Maria. Several thousand people died in that disaster, and the idea was that you could better empathize with them if somehow you could just insert your head into their suffering. Good times.

At the writing of this tutorial, Facebook has recently changed the name of their entire company to Meta, accompagnied by a cringeworthy video explaining their vision of the future as passing through the ‘Metaverse’.

Oculus Quest

This tutorial uses the Oculus Quest 1 & 2 headsets as our platform for exploring virtual reality, and Unity 2021.2 for building the interactive world inside these headsets. While the Oculus Quest is not the be-all and end-all headset of virtual reality — we are still waiting for someone to solve the myriad design and technological constraints of virtual reality — it does have the advantage of packaging all the basics of circa 2020 virtual reality into one entirely self-contained headset. With the Oculus Quest, you simply put the device on your head and it just works; making it an ideal device for public exhibitions of virtual reality.

Virtual Haiku & The City of Tomorrow

Starting during the 2020 confinement, my colleagues Marion Bareil and Pierre Rossel designed a series of courses (Virtual Haiku & The City of Tomorrow) around virtual reality headsets using the players’ gaze as the primary mode of interaction. Here are a few projects from that course:

And here are a few other projects from our Master Media Design that showcase the use of virtual reality headsets: