Here is some mood research I did to find inspiration for the visualizations of direct VS indirect movement. In our group, we also talked about using fire for the dynamic (indirect) movement. I’m not sure what we will end up using.
Name of piece: Active Points
Name of author: Vicky Bisbiki
Description: Free will narrative with changing but similar simple visualization and sonification.
Technology used in piece: Max, Projector, Kinect?
The part I like here starts at about 3:00. Most of this performance does not show what interaction designers call “strong mappings”. I enjoy the variations that can be accomplished with similar “paint”.
Here, the green path shows the actual mouse path. Each red line is the predicted path at a point. The more often the red path matches the green path, the more direct the path is.
One can imagine using a Kinect or Wiimote to generate this path. Once that is accomplished, interactive visualizations and sonifications can be mapped to this metric.
Tpoem is an interactive environment for writing lyrics or poetry. The web application makes rhyming suggestions as users type, placing the rhymes for the last of of each line in the right margin. These suggestions can be used to explore possibilities in writing poetry. Double clicking on a word sends it to a teacup that steams related words (near to distant synonyms).
Seeing rhyming suggestions is hands off and calm in the sense that no user initiation is needed beyond typing. Authors could use tpoem just a text editor and ignore the rhymes and steaming. Rhymes are most prominent where the text cursor is place. Moving one’s mouse over a line of rhymes reveals the complete set of provide rhymes, which can be pages long. This interaction creates a system and user feedback loop. As author changes what tpoem suggestions, the author changes the poem and tpoem modifies its recommendations.
Steaming is a lightweight and easy to implement generative suggester that hopes to inspire authors as they write. Instead of showing all realed synonyms, tpoem shows streams of words selected randomly from the pool of words related to what is inside the teacup. These simi-random juxtapositions are meant to inspire the author to make connections and see conceptual combinations. As words steam up in the left margin, they are juxtaposed with lines of the poem itself, affording many possible associations.
Tpoem also lets people publish tpoems. You can a list of user published tpoems I curated here.
In The Art of Interaction: Interactivity, Performativity, and Computers, Satlz discusses emerging questions about whether interactive technology is indeed new or simply art with technology tacked on. As a paper witten at most in 1997, hypertext and virtual reality are hot topics and mentioned throughout.
Performative technology and art requires:
- A sensing or input device translates certain aspects of a person’s behavior into a digital form that a computer can understand.
- The computer outputs data that are systematically related to the input (i.e. the input affects the output).
- The output data are translated back into real world phenomena that people can percieve.
But these components might be applied to all interactivity. Saltz uses hypertext to distinguish interactivity from interactive performances. Web browsing is about attention on a work rather than the user in the work. Virtual reality invites and requires an amount of imagination for a viewer to be immersed in virtual world. This contrast between interactions in a web browser and a virtual reality environment highlights the components of performative interaction.
The aesthetic understandings of virtual reality are about the realities they portray rather than the pixels used to “see” them. Saltz says we can draw these conclusions,
- Some but not all participatory interactions are performative.
- Participatory interaction is performitive when the interation is an aestheitc object.
Improve performances contain elements of randomness. Saltz concludes by mentioning that computer performers do not suffer from the fatigue an non-neutrality common to human actors. This always ready state is useful for creating interactive performances for interactive spectators.
In Live Media: Interactive Media and Theatre Summary, Satlz’s describes the role of live media in theatre, the classical western performance of scripted interactive plays. Highlighting experience from his own productions, Satlz emphasizes the need for fluid and forgiving forms of technology to interact with live performances. Enumerating a taxonomy of relationships between performers and media, Satltz concludes with an example of interactions from The Tempest.
Musical instruments are forms of interactive media devices. Newer technologies for playing, synthesizing, and manipulating media in realtime help complement the improvisational spirit of performance. In the IPL production of Hair, the productions crew mapped a library of images, sounds, and video keyboard keys using MIDI. This media instrument transfered the immediacy and spontaneous nature of improv on to the stage. A similar MIDI triggered approach is used in The Tempest to change backgrounds and manipulate the set.
Saltz’s taxonomy provides a foundation for thinking about interactions between human and technological performers.
- Virtual Scenery – serves as a background, which may be interactive or passive.
- Interactive Costumes – costumes with sensors, lights, or other dynamic aspects.
- Alternate Perspective – depicts a new perspective in a narrative.
- Subjective Perspective – shows a view of thoughts or gives insights into a character’s perception.
- Illustration – shows an illustration of a performers words.
- Commentary – supporting evidence in parallel with the overall narrative of a performance.
- Diegetic Media – media that exists within the world of the performance, such as a radio character listen to.
- Affective Media – media designed to change the audience’s emotional state.
- Synesthesia – remediates one kind of sense into a different modality.
- Instrumental Media – technology that creates an instrument from performer actions.
- Virtual Puppetry – technology that acts a character in a performance, usually controlled by a performer.
Saltz concludes by stating that his ultimate goal is to create performances that have dramatic relationships between media and performers, to the extent that media has as much as a role as performers do. This goal is now within reach.
For body movement art that doesn’t involve technology, I had to go back to just after my high school years. I took up martial arts as a sport and discipline from ages 15 to 20. The following is an example called Tun Da, which my instructor called Shaolin number 6. I saw a student perform this form with the same skill in person during a black belt test.
The forms in kung fu encapsulate narrative and philosophy that has been handed down and modified for generations. The style is formalized form where you are instructed to visualize an opponent and interpret meaning. A simple raising of the arm could be a block, an introduction to a grab, or a strike. The aim of the performer is to go through the motions of the form as fluidly, quickly, and with the most defined postures possible.
My experience in learning kung fu and forms caused me to see and understand body movement in terms of punches, kicks, stance and motive. The effect of doing on perception is interesting. I think of it as the body and mind as building a vocabulary of moments. This gives me a better perception and memory of fighting and other body movements. It also helped me tuck and roll during a bike accident last month.
Rhema Linder’s introduction for this course.
Department: I’m from the department of Computer Science
I have been a Master student here at Texas A&M since Fall of 2009. I am in the process of joining the PhD program. The Interface Ecology Lab works on a variety of projects. My research has mostly been in understanding how to evaluate creativity support environments in laboratory and field studies. I want computers to support human expression, information needs, and fun. People like to use existing images, text, and thought from the web and synthesize them as their own curations, and novel works. I want to make that process easier.
My artistic background includes creating software that supports creativity. One course project that I created is tpoem, an environment that shows rhyming suggestions and lets artists juxtapose words from a thesaurus as they write. When I was 15, a close friend and I made 3d game applications, which was my introduction to programming. Along with that came some introduction into adobe products.
I’ve worked on interaction design and implementation, search systems, scripts for statistics, computer graphics, machine learning, obscure networking protocols, and visualizations of complex data. While I know most popular programming languages, I prefer to work with Python. I’ve also designed processes on Mechanical Turk for generating and filtering text and image content. I also designed and implemente an ipad app for my 2 year old, which I suppose works for all of these three categories.
The following post in this new category are meant to record my process and process in the Interactive Performance and Technology course.