Pressure Project #3: Augmented Backgammon

Backgammon is the first board game ever in human history.

screen-shot-2016-12-16-at-7-19-27-pm
It is a mysterious mix of choices, strategy and luck. Properties of life I enjoy the most.

screen-shot-2016-12-16-at-7-28-32-pm

On my latest visit to Istanbul Turkey, I got a beautiful backgammon board.  I decided then, to bring it back and let my fellow artists co workers play with the augmented reality version of this game I created.

screen-shot-2016-12-16-at-7-16-01-pm

Thanks ACCAD for the awesome video on this piece.!

screen-shot-2016-12-16-at-7-27-01-pm

Axel Cuevas Santamaría VJ axx
https://axxvjs.wordpress.com/


Pressure Project #2: Dancing Depths

After Presure project 1: Staring at the Sun, I developed this new iteration.
It was an attempt to deliver a delightful automatic digital art piece experiment.

screen-shot-2016-12-16-at-6-49-23-pm

… an individual walks into a room in darkness where a MIDI controller interface awaits.

20160929_152116

The device, once activated by the individual, lets Isadora create a visually pleasing and self generating patch of shapes, lines, and color

20160929_151615

Visual textures are assigned to the dancing silhouettes of people inside the room

20160929_161734

This was my first experiment using kinect v2 and Isadora together

20160929_161902

Also, my first interactive dancing experience where my audience got activated

axel-cuevas-santamaria-vj-axx-microbial-skin-011

After this, I continued developing a more complex and integrated experiential media system for an interactive dance performance titled Microbial Skin

axel-cuevas-santamaria-vj-axx-microbial-skin-009

Thanks Alex Olizsewski and ACCAD for all the support!

Axel Cuevas Santamaría VJ axx
https://axxvjs.wordpress.com/

 


Pressure Project #1: Staring at the Sun

Description of the project in this link: https://axxvjs.wordpress.com/2016/10/20/diy-dome/

For this project, we experienced yellow color invading our spatial perception.

screen-shot-2016-12-16-at-6-08-38-pm

Inspired by Pi, the American surrealist psychological thriller film from 1998 written and directed by Darren Aronofsky, this is the project I developed.

text_01

The experiential media system for this project provided a mock-up for an immersive environment that allows users to shift our spatial perception.

https://axxvjs.wordpress.com/

After this experiment, I built a geodesic dome to test immersive possibilities.

axel_vjaxx_fulldome2016

I started building cardboard domes, for delivering immersive experiences.

axel-vjaxx-dome-2016_-0088

Axel Cuevas Santamaría VJ axx
https://axxvjs.wordpress.com/

 


folding_fours game

Playing connect four as part of class was a great experience!
Encouraged by Alex to find new possibilities, me and Ece figured a new challenge in this old game by adding the possibility of folding the paper every third turn.  This, after going deeper on the game with Ashlee, added a new experience: materiality.

The folding of the paper makes a richer physical level experience.

folding_fours


motiondetection01

As I started with fast motion detection action, I uploaded a first test patch.  Works best with lots of light in the room (darn) and with Input Menu/Start Live Capture to play. hope it works

Download Patch in this link:
axtest03_sept08_motiondetection01-izz


Pressure Project II

For our second pressure project we were tasked with creating a project with a Single person experience and a interface. As I was already thinking about story for my final project I wanted integrate intimacy and ideas of story told by the audience. I wanted to create a space in which the viewer was prompted to tell a story and then be audience to other stories about the same topic. I also want to using unconventional tactile Interface.

In the end I create a system which read one of my shirts and looked at the color to determine if it was there or not.  if the shirt was present it would trigger a text on the screen, that instructed the viewer to tell a story. This then would be captured to the computer and would be played along with all the other stories after the party was done. In theory this would work but in practice it kind of failed.  I don’t give myself time and the space to calibrate the computers understanding of the shirt under new lighting conditions.  And I had not quite figured out how do use Isadora’s captured to disk actor.

There where ideas in it that I were very attracted and will continue to work on. I really like the idea of a tactile interface being an everyday object, especially when the object hold significance or comfort. I was also interested in the different stories that me emerge from someone simply talking into a computer.


Pressure Project 3

For the Pressure Project 3 I used 2 colors as a dice to activate different interactivity modes. Firstly I created a square shaped, paper, two sided (red & blue) colored dice on a piece of string.

I introduced the dice to the viewer and asked her to experiment with it by showing it to the camera. In order to see the “trick” she needs to match the right side of the camera and the dice. I divided the screen in two half with the crop object and assigned red or blue colors to each side. Blue is tracked only on the left side of the camera/ screen and red is only on the right.

Blue color activates a different sound and blue visuals also the color picker triggers a type object that indicates “ “ in addition to a whisper soundtrack on the background. Red color activates a jackpot! İllustration with a changing scale based on the movement value and a clap soundtrack in order to indicate the “win”.

I used the dice as a symbolization of two different image and sound results that are presented to the viewer. Red symbolizes a winner theme while blue symbolizes a random/neutral trigger with the murmur and whisper sounds on the background. I tried to use blue for keep trying to find the right side and red as a finish point of the game (with a win). It seemed to work on the audience. They found both red and blue sides.

I tried to come up with a simplistic dice idea in order to enable the motion and flexibility of the object in front of the camera. Color code seemed to work well, which is an important feature to use/learn in visual programming. Also in addition to using chroma key object, I used inside range and measure color object for the first time. Measure color object works great, especially for measuring the exact numbers of RGB pixel values. I am surprised how much I learned from a dice concept. A dice can be anything that triggers different functions.

Here is the Isadora file: karaca_pp3-izz

dice

Two sided paper dice

Video is captured from the screens perspective, so when we see red side of the dice on the video, camera recognizes the blue and vice versa for red.


Cycle 1, 2 & 3

Hello,

I documented all parts of my process on my wordpress blog:

https://ecekaracablog.wordpress.com/2016/10/17/visualizing-the-effects-of-change-in-landscape/

I documented the process on my blog. All the visuals and sketches are on the website and the video is on the way.

Cycle 1:

While I was dealing with analysis of data, I came up with a very simple demonstration of variables in order to place them on a visual reference (map) to show the exact locations in the country. I wanted to show the main location by using a map, considering the audience might not know where exactly Syria is.

Text and simple graphic elements formed the main start of the project. After I shared it with the class the feedback I got was mainly around curious questions. One of my peers asked “What is sodium nitrate?” I could tell that he understood that chemical was not good for environment or health. Another classmate continued, “They attack to cultural areas during wars, like they are trying to destroy the culture or history of nations.” That comment helped me to add more on to the project and consider the different results of the war, connected to the same ending “damage”.

After more research and analysis I had to admit that I can’t use clear Satellite imagery or maps for the infographic, which would’ve been a great tool. I learned from Alex, since the war is still ongoing Google Maps have some restrictions in the war areas. All I got from Google Maps was pixelated, blurry maps. I moved on with abstract visualizations applied on map imagery, also included photographs from cities to the final outcome.

Cycle 2:

I believe the feedback that I got from the Cycles helped me a lot to consider the thoughts of my peers. When we work on our projects for long time periods, being subjective and critical towards the become harder. Since I worked on the collection, analysis, sketching and design of the dataset by myself, I was clear about the details of the dataset while I knew it was still too complex for the viewers. In the end the dataset and design is still too complex. It was decision I made for my first complex interactive information design project. Because the analysis of data showed me the complexity is the nature of this project. There is catastrophic damage given to a war country and even a small detail, an environmental issue I tried to visualize is connected to multiple variables on the data set. Therefore I used the wires to show the direct connection between variables and communicate the country is wired with these risks and damages.

Since my peers saw the work and heard me talking about the project, they were more familiar with it. So I was not sure the project was clear to them but I got a positive feedback in the second cycle. I’ve been told that the project looks more complete.

After I got feedback from Alex, I started to think about an active/passive mode for the project. I included a sound piece from the war area, that is activated by the audience walking by the hall in front of my project. The aim for the sound is to take the attention of the audience to the work and give an idea about the topic. Camera to track the motion sees the people passing by and activates the sound afterwards. Since I want the audience to focus on the data set, I targeted the potential audience for the sound part.

I believe sound completed the work and created an experience.

I know the work is not very clear or ideal for the audience, but I wanted to push the limits of layering and complexity in this project. Taking the risk of failure, I am happy to share that I learned a lot (from everyone in this class)!

Right now I have a general understanding of Unity, I know how to add more and manipulate the code (even I don’t know about complex coding). I learned the logic of Unity prefabs, inspector, interactivity and general interface. In addition to MAX MSP (used it last year), I learned using Isadora, which is way more user friendly. Finally I learned using a 3rd information design software called Tableau, which helped me to develop the images (under Infographic Data) on my blog.

I have very valuable feedback from my peers and professors. Even if the result was not perfect I learned using 3 softwares in total, had fun with the project, experimented, pushed the limits and learned a lot of things!

Please read the complete process from my blog. 🙂


Pressure Project 2

The assignment requires physical material input, so I experimented with Makey Makey for the first time. While using marshmallows as an interactive board, I assigned 4 different cues to each of them. Also, I included the camera input and blob objects to control the speed and movement of the work, which are controlled by the viewer.

The opening scene is an automated/wave generated objects and filters. Filters respond to the sound level in the room. Also random text commands respond to the high sound level. Based on the level of sound the text appears/disappears on the screen.

A quick summary of the project:

Interacting with 4 marshmallows activate 4 different soundtracks and visuals. The final work on screen is controlled by the viewer:

  • 4 different music track – Speed of the tracks controlled by sound level watcher, the louder sound level increase the speed of track.
  • 4 different visual scenes – different colors, objects and filters are used for each scene (and each marshmallow) which are controlled by the motion tracking.
  • The background sounds are different versions of instrumental music, even if they don’t sound like it! It was a happy accident (not the prettiest one). While I was experimenting with the sound level watcher, accidentally connected a wire to sound speed and it became a different sound then expected so I kept that system.

Working with Makey Makey added a fun, clear cue to work, giving a direction to the viewer. However the system was still mysterious and it took time for audience to understand the functions.

I believe using text objects create an interactive communication with the viewer. Almost starts a different type of conversation.

Overall it was a fun project and working with a new tool has been a new learning experience.

Here is the isadora file and a video of the project. karaca_pp2-izz


‘You make me feel like…’ Taylor – Cycle 3, Claire Broke it!

towards Interactive Installation,

the name of my patch: ‘You make me feel like…’

Okay, I have determined how/why Claire broke it and what I could have done to fix this problem. And I am kidding when I say she broke it. I think her and Peter had a lot of fun, which is the point!

Claire & Peter

Claire & Peter

So, all in all, I think everyone that participated with my system had a good time with another person, moved around a bit, then watched themselves and most got even more excited by that! I would say that in these ways the performances of my patch were very successful, but I still see areas of the system that I could fine tune to make it more robust.
screen-shot-2016-12-15-at-5-54-05-pm

My system: Two 9 sided shapes tracked 2 participants through space, showing off the images/videos that are alpha masked onto the shapes as the participants move. It gives the appearance that you are peering through some frame or scope and you can explore your vantage point based on your movement. Once participants are moving around, they are instructed to connect to see more of the images and to come closer to see a new perspective. This last cue uses a brightness trigger to switch to projectors with live feed and video delayed footage playing back the performers’ movement choices and allowing them to watch themselves watching or watching themselves dancing with their previous selves dancing.

under the hood - Shapes + alpha mask, Video In /delay /freezes

under the hood – Shapes + alpha mask, Video In /delay /freezes

The day before we presented, with Alex’s guidance, I decided to switch to the Kinect in the grid and do my tracking from the top down for an interaction that was more 1:1. Unfortunately, this Kinect is not hung center/center of the space, but I set everything else center/center of the space and used Luminance Keying and Crop to match the space and what the Kinect saw. However, because I based the switch, from shapes following you to live feed, on brightness when the depth was tracked at the side furthest from the Kinect the color of the participant was darker (video inverter was used) and the brightness window that triggered the switch was already so narrow. To fix this I think shifting the position of the Kinect or how the space was laid out could have helped. Also, adding a third participant to the mix could have made (it even more fun) the brightness window greater and increased the trigger range, so that the far side is no longer a problem.
screen-shot-2016-12-14-at-8-38-57-pm

I wonder if I should have left the text running for longer bouts of time, but coming in quicker succession? I kept cutting the time back thinking people would read it straight away, but it took people longer to pay attention to everything. I think this is because they are put on display a bit as performers and they are trying to read and decipher/remember instructions.

The bout that ended up working the best, or going in order all the way through as planned was the third go-round, I’ll post a video of this one on my blog which I can link to once I can get things loaded. This tells me my system needs to accommodate for more movement because there was a wide range of movement between the performers (maybe with more space, or more clearly defined space). Also, this accounting for the time taken exploring I have mentioned above.

dems-cycle3-taylor-izz