Walls Beyond Walls

An immersive virtual reality experience that fuses cutting-edge image processing technologies with creative gameplay mechanics. Built with Unity and integrating advanced tools like ComfyUI, this game takes you on a journey through diverse environments, each with its own narrative and gameplay challenges.

In Walls Beyond Walls, players will explore a world where creativity and imagination have no limits. Each scene within the game presents a unique story, unfolding through innovative mechanics that allow players to manipulate and create artwork in real-time. From combining random objects into surreal masterpieces to expanding images beyond their original boundaries, this game transforms the player's input into dynamic, visually stunning experiences.

Full Gameplay:

A Brand New ComfyUI Pipeline:

We created our own C# library to integrate ComfyUI requests to an external server into Unity. Integration with Unity for the complex requests required for our experience is unprecedented. The new library enabled us to generate new images in real-time for the experience.

Key Mechanics:

• Creative Image Fusion: Combine unexpected elements from the world to create entirely new artworks. What would a fusion of the Mona Lisa and a yellow duck look like? Discover endless possibilities as you experiment with objects in your environment.
• OutPainting: Take a simple image and extend it into a larger, more complex piece. Using this mechanic, players can grow their artwork outward, generating expansive canvases that evolve with their creative direction.
• Hybrid Image Creation: Combine two distinct images—like a mouse and a keyboard—and watch as they blend into a seamless hybrid. This mechanic allows for boundless experimentation and unique visual results.

With its rich narrative structure and a variety of imaginative tools, Walls Beyond Walls offers players a one-of-a-kind VR experience where they are both the artist and the explorer. Whether you are looking to test the boundaries of your imagination or simply create stunning visual art, this game promises to take you beyond the ordinary and into a world of limitless creative potential.

Game Walkthrough:

Throughout the experience, the player navigates  through 5 scenes:

Exhibit:

The player walks through an exhibit and discovers the AI tool he will use to generate images throughout the experience.

Tile Room:

The player enters a room made up of tiled white panels. Some of the panels are already filled with various images, which the player can select multiple of to combine into a new, AI-generated image. After doing such, the player can also combine an image with a random object in the room to generate a new image.

Museum:

The player explores a  museum, and begins snapping photos of it. After snapping a photo, the player can select one of the paintings in the museum and transfer the style of the chosen painting into the photo they took in order to generate a new image.

The Park:

The player walks through a park and finds a canvas that is painted with an image in the middle. The player grabs various objects throughout the scene and clicks on the missing tiles of the canvas. The canvas is expanded into a larger painting, where in each tile the object the player chose shows up.

City Square:

The player finds himself in a city square. There are various objects scattered throughout the scene, which the player can grab, "charge", and throw. When the player throws the objects, images of the object they threw fill the surface where the object landed. The player continues throwing objects, and after each time they throw an object the more images it fills the surface of the city square with. Eventually, things spiral out of the player's control...