Archive for the 'University' Category

01
Jun
11

Id machine: exhibition concept

I began making a model to describe the concept I want for my exhibition, I wanted to alter the sense of space for the viewer. I want the participant to sense that something isn’t quite right as soon as they have entered the space.

The desired effect is to create and eerie sense of perspective when entering the exhibition, this is known as forced perspective.

Forced perspective in architecture

“In architecture, a structure can be made to seem larger, taller, farther away or otherwise by adjusting the scale of objects in relation to the spectator, increasing or decreasing perceived depth.For example, when forced perspective is used to make an object appear farther away, the following method can be used: By constantly decreasing the scale of objects from expectancy and convention toward the farthest point from the spectator, an illusion is created that the scale of said objects is decreasing due to their distant location. In contrast, the opposite technique was sometimes used in classical garden designs and other “follies” to shorten the perceived distances of points of interest along a path.”
I can apply techniques like The Kellison Sticks method in order to produce correct mathematical proportions.
There is a strong history of forced perspective in film making, one of the most notable examples can be found in Hitchcock’s work ‘Vertigo’, here the dolly/zoom technique produces acts as an unsettling metaphor for ‘Scotties’ fear.

Hitchcock's 'Vertigo'

this technique is used in film making “…to suggest that a character is undergoing a realization that causes him or her to reassess everything he or she had previously believed”.
It’s this unreal situation that I want the participant to take part in, I want an odd sensation that things aren’t what they seem to permeate the whole experience, to act as a signifier that you are entering a world with different rules. I want to also refer to other metaphors for entering a surreal space, for example the concept of entering ‘deeper down the rabbit hole’ in Alice in Wonderland
I also want the placement of the frames in my exhibition to reflect the nature of sound itself,  as if the frames were markers for the ripple effect from the waves of sound being produced.

Sound Waves and their Sources 1933

I want to do my up most to ensure that the experience is as immersive as possible. It has always been my intention to produce a cognitive and emotional response within my participants in the same way cinema does with it’s viewer, will I be able to achieve this?….I think so
Advertisements
23
May
11

Id Machine: Show design sketch

Here are some initial designs for appropriate exhibition space for my project within the AUCB degree show

degree show design sketch 1

degree show design sketch 2

04
May
11

Id Machine: Demonstration of Function

Demonstration of Id Machine prototype working

29
Apr
11

Id Machine: animatronic prototype

Here is a demonstration of a subject interacting with the kinetic and audio elements of the Id Machine Prototype

The system tracks the users face and responds by turning the horn of the gramophone object toward the user. When the user makes a sound the audio is recorded, analyzed, categorized and placed into a database, then the system ‘decides’ upon a response from the database and plays that recording to the user

26
Apr
11

Id Machine: space tests

Testing the funnel shape concept for exhibition installation. creating a funnel shape toward the gramophone will focus attention and ensuring that the space is some what compact will allow the horn to dominate the space


I am inspired by Anish Kapoor’s use of space and perspective, his careful direction of space informs how the viewer uses and understands their environment. The experience has a level of engagement and immersion that I wish to explore in my own use of space.

25
Apr
11

Id Machine: Index

‘Id Machine’ is a prototype interactive installation, it comprises of kinetic sculpture and interactive audio software, these elements are combined to make a unique interactive scenario to be used within a gallery context, the work takes the form of a vintage gramophone and microphone , the participant takes part in the scenario by walking into the scene and producing audio into the microphone. The gramophone horn reacts to the users presence and turns to face them, once a recording has been made the gramophone ‘thinks’ and produces a response. For the moment the response is based on the physical attributes of the recording, however through further development my aim is for the system to analyze content of speech and produce an ‘appropriate’ response from predetermined criteria. Then my aim is to take this scenario further into the area of artificial intelligence, my final goal being to apply an element of the psyche (the Id, as described by Sigmund Freud) in it’s behavior and decision making. I am also engaged in developing multidisciplinary uses for this project in areas such as computer science, psychology, sociology, fine art and exploration of new ways of engaging with narrative. it is currently in a prototype stage (April 2011) and will be used as a proposed research project for a Masters degree.

for further information please use links below, they are divided into relevant topics

Interaction design:

defining-the-project-part-1-id-machine

id-machine-social-cues

drafting-id-machine-demo

drafting-id-machine-demo-part2

id-machine-demo-basics

id-machine-flowchart-development

id-machine-animation-sketching

id-machine-p-o-v-animate

point-of-view-id-machine-demo

id-machine-motion-tracking

id-machine-interaction-tests

id-machine-space-tests

id-machine-animatronic-prototype

id-machine-demonstration-of-function

id-machine-show-design-sketch

id-machine-exhibition-concept

mechanical development:

id-machine-kinetic-mechanics-sketch

id-machine-development-of-kinetic-sculpture

id-machine-development-of-kinetic-sculpture-part-2

id-machine-development-of-kinetic-sculpture-part-3

id-machine-development-of-kinetic-sculpture-part-4

id-machine-motion-tracking

software development:

id-machine-audio-analysis

id-machine-max-patch-development

id-machine-face-recognition-to-servo-action-design

id-machine-interaction-tests

id-machine-audio-improvements

testing

id-machine-the-voice

id-machine-recording-sound-tests

id-machine-speaker-and-servo-adjustment

id-machine-audio-improvements

id-machine-conversation-dynamics-and-artificial-intelligence

id-machine-space-tests

id-machine-animatronic-prototype

id-machine-exhibition-concept

Computer science:

Turing test and chat bots-Eliza

id-machine-conversation-dynamics-and-artificial-intelligence

Kismet-social robotics

id-machine-social-cues

robots-are-about-people-cynthia-breazeal

id-machine-conversation-dynamics-and-artificial-intelligence

animatronics:

id-machine-demonstration-of-function

id-machine-animatronic-prototype

id-machine-character-and-movement

psychology:

research-the-perverts-guide-to-cinema

id-machine-kinetic-mechanics-sketch

id-machine-conversation-dynamics-and-artificial-intelligence

sound, audio, the voice:

id-machine-research-sound-science-and-the-1950s

id-machine-audio-analysis

id-machine-the-voice

id-machine-recording-sound-tests

id-machine-speaker-and-servo-adjustment

id-machine-audio-improvements

id-machine-animatronic-prototype

22
Apr
11

Id Machine: Conversation Dynamics and Artificial Intelligence

'Gramophone Man' - Jeffrey Richter

As I have stated in my learning agreement. I consider my project Id Machine to continue past BA (Hons) evaluation. My intention is to use Id Machine as a research project, although my ambitions are far stretching, I have in mind and in planning, practical solutions to reach them.

The direction my research will take after my EMP critique is toward the content of audio input. As my project stands it is the qualities of the voice I’m using as my attributes. For now it is frequency that the system uses as data to judge by. The next step then, is to attribute more detail to analysis of the audio input data stream. With a firmer grasp of the characteristics of the recordings made, a more engaging and dynamic ‘conversation’ is possible

I understand that there is a long history in the direction of  conversation between man and machine and I will continue to reflect on the outcomes and impacts that have prevailed through this line of discourse further and later.

Watson robot on Jeopardy

Chat bots are designed for this very purpose (conversation), in most cases such as Eliza,  the ‘conversation’ is directed to persuade the participant that they are conversing with another human being, this is usually done through complex systems including decision trees and language processing techniques such as the use of keywords and referencing e.t.c. The success of this belief that a machine can fully converse like a man is considered as a milestone in artificial intelligence since the proposal of the Turing test in the article “Computing Machinery and Intelligence” (1950) and since then, it has been a subject of great focus for computer scientists, philosophers and many others alike.

It is important to note the creator of Eliza used the project to some extent to debunk the test and to showcase the artifice of an attempted project.

“machines are made to behave in wondrous ways, often sufficient to dazzle even the most experienced observer. But once a particular program is unmasked, once its inner workings are explained … its magic crumbles away; it stands revealed as a mere collection of procedures … The observer says to himself “I could have written that”. With that thought he moves the program in question from the shelf marked “intelligent”, to that reserved for curios”-Joseph Weizenbaum

I am acutely aware that my own project is bound to suffer from the same sense of falsehood, but my intent is not to fool an engaged viewer with false characteristics of a human speaker/conversationalist. But to immerse a participant into an engaging scenario in order (to some extent) for them to suspend their disbelief and to produce thoughtful and emotional interaction in a similar way to the suspension of disbelief in cinema and other narrative productions.

I will produce a machine…a system that will be imbued with elements of personality. Not one that intends to directly copy a person in human to human interaction.

anthropomorphisation in film

Storytelling has long used inhuman symbols and through processes such as anthropomorphization… these characters have caused audiences to empathize and related to them. Id Machine will have some very simple qualities of human conversation, but it is not the inherent qualities that are of interest…it is the action, reaction and projection of those that interact with it. I will direct the scenario in a similar way to that of a theater production.

What is unique about my project, is the fact that the content is entirely user generated. All input and output is audio recorded during the interaction. This work is also generative. The more participants interact with it, the broader the scheme of content. When this becomes the case each interaction becomes close to unique.

Onto practical applications. The first step is in matching audio input to models of simple conversational elements. for example I may be able to make an educated assumption of the participants age and gender by mapping the audio input against a model such as this

Pitch change through aging (Male and Female)

I could then include this assumption as metadata applied to the audio recording itself. Of course I will need more accurate models and equipment to get to this level.

I could also generate a model of  conversational elements, for example a model of a question, this could be determined through analysis of pitch inclination (see proposed model below).

Potential input matching model example for 'question' inclination

I may then be able to apply this method to more abstract concepts for example a model of intent, perhaps I can determine aggressive input by creating a model through a combination of vocal phrasing and volume analysis in order to create an assumption that if the input is loud and short in delivery that these properties represent aggressive intent in the content.

Potential input matching model example for 'question' inclination

Once I am able to determine these elements of conversation, fully and with accurate definition. I can produce greater ‘intelligence’ in my system by providing broader and more focused decision making elements against my stream of data.

The next major step is in determining aspects of conversation dynamics, the process of conversation is an integral part of socialising, this in turn is part of an integral desire to communicate. The way in which we communicate is incredible complex

“We are the only creatures on earth (as far as we know) that can remember the past as discrete events, then connect those events with present conditions. Then, on the basis of those connections, we can consciously decide what to do, and project possible present actions into the future consequences of those actions. Thus, unlike other animals that react to stimuli as they occur, humans live not only in the present, but in the past and the future. It is this ability to remember the past, relate it to the present, and project into the future that is a special province of humans”- ‘Taking ADvantage: Social basis of human behavior‘- Richadr F Taflinger

this will be a major topic of research later in my project. For now I will deal with assumptions backed by research. This research will inform my direction of the intended scenario. for example behavior during the act of turn taking during a conversation

“Turn-taking dynamics. In a given conversation, only one person (the speaker) speaks at any given time before another (different) participant (a listener of the same group) is entitled to speak. Within a single conversation, several non-overlapping sub-conversations can nucleate”-Massimo Mastrangeli, Martin Schmidt and Lucas Lacasa (2010)

This element will play heavily during the experience of my installation. Instantly a power dynamic is created simply through the act of speaking and listening. The act of turn taking will produce interesting sociological and psychology information.

“Joining/leaving force balance. Participants in a specific conversation remain in the conversation as long as they feel actively involved in it up to their preferred degree; otherwise, they start to wish to leave the conversation. We model this lively behavior by assigning a degree of happiness to each participant of the conversation. Happiness hereby stands for e.g. attention span, patience, assertiveness, self-esteem, and more: it is the index of the willingness of a participant to remain in a given conversation”-Massimo Mastrangeli, Martin Schmidt and Lucas Lacasa (2010)

This is of great concern for my project, participation in ‘conversation’ is key for all other information gathering and the overall quality of content. I will need to think further of ways to derive information of intent from a user.  It will be difficult for me to accurately measure a participants will in a live scenario so I must think around this problem.

Rorschach tests

Ideally the the scenario I’m looking to create is a kind of Rorschach test in which the interpretation and response of the participant is a point of interest and study. What’s more this particular interaction means that the participant is both providing information and interpreting information that others have provided. The interaction becomes a dynamic psychological environment

To do this propely I need to have greater control and direction for the audio output, I need to understand how conversation works and what other parameters I can use as data to process deeper in order to engage the participant further and provoke conversation.




%d bloggers like this: