Tuesday, September 11, 2012
Soundtracks 2: Methods
Interface and Dimensionality in Music Spaces
Continuing from "Played Meaning" -- How are values generated in play when we're not given explicit goals to pursue? One way: engagement with material presence and its variability. Sound, image, touch, interface, feedback-- IMMANENCE -- chaotic movement of emerging and collapsing possibilities.
Boundaries, whether goals or materials/actuality are-- constrained possibilities.
Practical applications of this idea to music design
--seeking fluid spaces--
--seeking fluid spaces--
with new soundtracks for:
Super Mario Galaxy
Assassin's Creed
&
&
Psychonauts
//
//
1 - Super Mario Galaxy Ballet
For every change of state [process, event] in a game, there should be a corresponding change of state in its soundtrack.
Interactive mickeymousing -- first guideline for a musical-cybernetic realism, systemic representation of the idea that every change of state in the perceived world is itself a movement of energy, vibration. Vibrations, material variability-- light, sound, touch, & movements of consciousness, moods, ways of being.
If a soundtrack adheres to this dogma, it can be considered realistic.
Searching for grounds of this new realism-- basins of attraction, affinities and repulsions in our played experience of the game space, leaving behind Dogma 1:
If a soundtrack adheres to this dogma, it can be considered realistic.
Searching for grounds of this new realism-- basins of attraction, affinities and repulsions in our played experience of the game space, leaving behind Dogma 1:
3 - Musical Dimensionality
A realism of movement-as-creativity-- vibrational play in fluid possibility spaces. Games-- play in possibility spaces. Games best represent creative reality by becoming fluid--using continuous variables (i.e. range 0 - 100.) as opposed to constants (i.e. 23) or booleans (1 or 0)---and by becoming perceptibly vibrational, with sound and light and touch feedback.
The structures of sound feedback, music, with their relationships and meanings emerging in play, seem to have a curious relationship to the play of fluid systems more generally.
The way the experience of music dissolves the discrete relationships between sound objects and events is a useful mental model for designing (and playing in) shifting possibility spaces.
Games as objects in motion >> Music as objects in motion >>
The way the experience of music dissolves the discrete relationships between sound objects and events is a useful mental model for designing (and playing in) shifting possibility spaces.
Music objects: note, mp3, chord, A-section, B-section, voice, guitar, fermata, melody, reverb, granulizer, [cos~], etc. These objects are not static-- rather, they're defined by variables, little worlds of objects making up the bigger objects.
The melody went up, but it just as well could have gone down. The chord was a C major, but it just well could have been a c minor. The mp3 was played at normal speed but it could have been 50% speed. The Eb could have been an F. The magic circle is elastic, pulled and twisted when its boundaries are engaged. All of the objects themselves are defined by variable qualities-- possibilities. As such these objects might better be understood as spaces. Music is the organization of these shifting spaces.
Like in a phase space, which maps relationships between variables in a system (above-- 2 and 3 dimensional phase spaces), representing a musical space will require 1 dimension per variable.
Western music notation is a 2-dimensional plane-object (page) with further embedded dimensions at lower levels (> staff > symbols).
The staff object-- horizontal dimension represents time, and vertical dimension represents the present moment, pitch information:
Western music notation is a 2-dimensional plane-object (page) with further embedded dimensions at lower levels (> staff > symbols).
The staff object-- horizontal dimension represents time, and vertical dimension represents the present moment, pitch information:
Object-types placed on the staff are themselves variables or spaces. A fermata means hold, but doesn't say how long-- it's an open space. An eighth note is a selection from the class of note-heads and -tails (whole note, quarter note, eighth note, etc.), which determines the duration of the note. The class of clef (treble, bass, alto, etc.) determines how the staff is mapped to actual pitch-values. We can describe any musical object as a space and/or a position in a space-- an object / a component of an object. The categories are not rigid-- determining the members of a class is a compositional choice.
As flat visual information, the language of musical symbols also exists in a 2 dimensional space, but at a lower level than the staff (which, again, is one level lower than the page). The symbols are the objects which play on the staves, which are the objects which play on the page. The vertical and horizantal dimensions of symbols don't measure anything in particular, they just offer a space for the symbolic images to be constructed in.
This is an impossible project on a 2-d cartersian-XY plane, so we need to look for different representations of dimensional movements and relationships.
Western music notation's stacked dimensionality (page > staff > symbols) is a great solution given the constraint of the page as a static space. Dimension 3 embedded in dimension 2 embedded in dimension 1.
And its potential for layering musical information is very powerful, allowing for the emergence of new complex objects built from symbol and staff units. Layering staff-planes vertically (a higher level of 2-dimensionality, containing the first), Western notation allows for simultaneous play by multiple voices (players), each its own contained space of other spaces in motion, and thus emerges the fluidity of texture, shifting relationships between what objects are present and what they're doing:
There's a lot going on there, including many composite-objects that have emerged from a lower level-- like harmony (emerges from layered pitch) and textural qualities, like which players are playing in unison with one another (emerges from layered staves). Some emergent objects are more intuitively represented by the notation than others. For instance, in the above image, you can see from the shaped paths of symbols on staves that the fourth staff from the top and the second staff from the bottom are playing in unison (rhythmically, at least)-- texture is seen to be communicated fairly intuitively. Harmony, on the other hand, we have little chance of decoding from this distance-- and even once we zoom in, the system of #s and bs doesn't represent very well the fluid centers of gravity/tonality which give the vibrational presence of the sound its meaning.
The game of classical music theory/analysis is an attempt at systematic decodings of musical spaces like these. Creating systems of harmonic, motivic, structural (etc) objects and their interrelationships. There's likely a lot to learn here, though all too often analyses are primarily concerned with pitch/harmonic information and discrete-structural chunks, the fixedness of the objects, avoiding the more difficult but also more interesting task of finding ways that fluidity emerges from shifting relationships between objects playing in dimensionalities across all hierarchical levels.
from "The Rite of Spring" by Igor Stravinsky
There's a lot going on there, including many composite-objects that have emerged from a lower level-- like harmony (emerges from layered pitch) and textural qualities, like which players are playing in unison with one another (emerges from layered staves). Some emergent objects are more intuitively represented by the notation than others. For instance, in the above image, you can see from the shaped paths of symbols on staves that the fourth staff from the top and the second staff from the bottom are playing in unison (rhythmically, at least)-- texture is seen to be communicated fairly intuitively. Harmony, on the other hand, we have little chance of decoding from this distance-- and even once we zoom in, the system of #s and bs doesn't represent very well the fluid centers of gravity/tonality which give the vibrational presence of the sound its meaning.
The game of classical music theory/analysis is an attempt at systematic decodings of musical spaces like these. Creating systems of harmonic, motivic, structural (etc) objects and their interrelationships. There's likely a lot to learn here, though all too often analyses are primarily concerned with pitch/harmonic information and discrete-structural chunks, the fixedness of the objects, avoiding the more difficult but also more interesting task of finding ways that fluidity emerges from shifting relationships between objects playing in dimensionalities across all hierarchical levels.
How we describe musical possibility spaces is an implied project in musical instrument design, music theories, notations-- all musical interfaces, which could be analyzed in terms of their stacked dimensions, as one way of identifying nodes of connectedness and paths of movement.
Graphic scores offer new ways of navigating the 2-dimensional plane (page) of musical information, often by being less systematically precise (but more visually evocative), so that object relationships can emerge in play with more fluidity, an important precedent of games/fluid visual systems -as-movement.
from "Treatise" by Cornelius Cardew
Videogames are musical interfaces. And, being dynamic, they're of particular interest, re: fluidity. What was was possible at one moment isn't at the next-- possibilities shift. The information, and space, we're given at one moment is gone the next. Like pages and staves and symbols coming and going, morphing and transforming, in games dimensional-crossings open and close in real time, a new detail pulling us down into a lower level, another pulling us across dimensions, another shooting us back up to the higher-level object made of those component objects, and up and up and down and across until the dimensions dissolve into pure movement, pure nowness-- the game itself in the world, our being-in-the-game in the world.
4 - Psychonauts Walkthrough
Psychonauts + new score >> mental model of motion-creativity-- walls of a psychedelic (psychê-dêlos / ψυχή-δηλος meaning mind-manifesting) space, coloring ways-of-being with the shifting moods of sense-possibility.
Screen as a visual interface for musical play, much like a Western score, but these possibilities slide, they are not fixed. Movement between dimensionalities here is equated to alternation between different modes of play, engagement of different variables.
So-- pseudo-algorithms, a verbal/written score, the kind of discretization of fluidity that will be needed to implement a music space like this in code. How can music be designed (fixed) fluidly? :
//
Screen as a visual interface for musical play, much like a Western score, but these possibilities slide, they are not fixed. Movement between dimensionalities here is equated to alternation between different modes of play, engagement of different variables.
So-- pseudo-algorithms, a verbal/written score, the kind of discretization of fluidity that will be needed to implement a music space like this in code. How can music be designed (fixed) fluidly? :
//
(:00) - Grinding on a handrail. Automated linear movement in one of two directions, left or right. Loop's playback direction switches based on left (reversed) or right (forward). Switching direction plays melodic event sounds, scale intervals 5, 1.
(:08) - Camera cuts to new perspective, in same room as the avatar. Cut is accompanied by arpeggiated sound event, introduction of fluid room motif. Changing directions also triggers changes from the room's dimension of the sound space.
(:14) - Sliding down ramped handrail. Handrail loop material is pitch-shifted up a whole step, +2 semi-tones. Bell-shaking event plays along with slide.
(:15) - Landing event, dimension of room motif, new key having been introduced by sliding down the handrail. Handrail loop and bell-shakes fade out.
(:16) - Footsteps are accompanied by diatonic scale tones in the new key. Room motif accompanies loosely.
(:21) - "eyes opening", arpeggio up.
(:23) - running on platform, motor rhythms accompanying run-tempo.
(:29) - hop off platform, no sound "effect", instead introduction of a new harmonic rhythm, which stays around for 2 seconds while the avatar is obstructed from the camera by the wood of the platform.
(:32) - flute ornamentations enter, accompanying flight of butterflies on the screen.
(:37) - bright tinkly sound fades in, accompanying shiny object past the fence.
(:39) - jumping stops motor rhythm. jumps cycle through an array of chords. Extra triangle ding accompanies sphere-effect jump.
(:42) - volume swells briefly while spinning over fence. then we hear a mixture of walk and jump motifs for a few more seconds
(:44) - falling, ilinx
//
How might this have sounded if we played differently / went someplace else? Playing with the touch of the controller, do some musical interactions seem more compelling than others? Which of the game's mechanics weren't scored & how might they have been scored?
What would verbal/pseudo-code event-scores for the two preceding videos (Mario Galaxy Ballet, Assassin's Creed) look like?
//
How might this have sounded if we played differently / went someplace else? Playing with the touch of the controller, do some musical interactions seem more compelling than others? Which of the game's mechanics weren't scored & how might they have been scored?
What would verbal/pseudo-code event-scores for the two preceding videos (Mario Galaxy Ballet, Assassin's Creed) look like?
5 - Practice
The practice of scoring game mechanics with music that aims for a 1:1 relationship with them is still not very common. My hope is that the above examples begin to demonstrate that games-as-music are entirely possible, and not even particularly difficult to explore conceptually, when built on the foundations of the above rule of corresponding state-changes (music-game), which of course can, and ought, to be broken (but considered a rule nonetheless).
The rest of the rules we follow or push are supplied by a game's mechanics themselves.
We need to open ourselves to games' existing played time-structures. A common approach to making music games is to introduce a system of quantized timing (even subdivision of flow into time-units, often measured as a sixteenth-note pulse), so that the music grooves automatically, plays with a steady beat. But most games don't play like this. Nor does most music. Our systems of musical representation (i.e. the 16-step sequencer) suggest that music is quantized, but this is only the case in some virtual spaces. In played-actuality, music is smooth, even when it tends toward even subdivision. Don't be afraid to turn off quantization-- open up to response structures, emergent rhythms, these are games' best friends.
If a game being scored has even an average interaction density, the compositional process of designing its soundtrack according to the music-game rule of corresponding change will involve creating and manipulating many many music objects. Most composers are used to composing full pieces made of smaller units-- such processes will need to be redirected here. The smaller pieces, or modules, are what's needed content-wise, the "full" piece being the space of possible movement itself, the music design, which might resemble a more detailed version of the Psychonauts walkthrough (i.e. the rules for John Zorn's "Cobra").
Many objects seem to want to stay fixed (like recorded music), but they will need to move if they're to be plaeyd. Find tactics for penetrating into objects and dissolving them into their components and their potential for played variability. Build notes, motifs, textures, loops, processes. Build events from these, sequences, liquid stories. New game object? New story. Composition will need to happen so frequently and quickly, it would be good to develop an improvisational relationship to it, being able to compose without stressing about doing anything well, just playing in whatever the most efficient and fun way might be. Not a full orchestra, unless there's a well thought-out strategy developed to dissolve its unity. Want an orchestra? Whatever MIDI sounds should do you just fine, or use samples-- modules can easily be cut and shaped from existing recordings, and there's loads of music in the public domain filled with amazing sampleable bits. Don't let "it's too much work" be an excuse to not fill out music designs, just be lazier about it, automate the work, play it always. The content doesn't matter too much anyway-- it's how it moves.
To practice designing music in this way, more videos like the above could be made using the same technique-- music design without even having to touch code, like scores without a performance. At every change of state, we face interesting compositional decisions to play out, possibilities to navigate, movement in so many undiscovered dimensions. We could make games like this forever. Yes, You Can Make Games, but don't think you have to touch programming to do it-- just keep moving.
The rest of the rules we follow or push are supplied by a game's mechanics themselves.
We need to open ourselves to games' existing played time-structures. A common approach to making music games is to introduce a system of quantized timing (even subdivision of flow into time-units, often measured as a sixteenth-note pulse), so that the music grooves automatically, plays with a steady beat. But most games don't play like this. Nor does most music. Our systems of musical representation (i.e. the 16-step sequencer) suggest that music is quantized, but this is only the case in some virtual spaces. In played-actuality, music is smooth, even when it tends toward even subdivision. Don't be afraid to turn off quantization-- open up to response structures, emergent rhythms, these are games' best friends.
from "De Kooning" by Morton Feldman--
timing system based on response rather than subdivision
If a game being scored has even an average interaction density, the compositional process of designing its soundtrack according to the music-game rule of corresponding change will involve creating and manipulating many many music objects. Most composers are used to composing full pieces made of smaller units-- such processes will need to be redirected here. The smaller pieces, or modules, are what's needed content-wise, the "full" piece being the space of possible movement itself, the music design, which might resemble a more detailed version of the Psychonauts walkthrough (i.e. the rules for John Zorn's "Cobra").
Many objects seem to want to stay fixed (like recorded music), but they will need to move if they're to be plaeyd. Find tactics for penetrating into objects and dissolving them into their components and their potential for played variability. Build notes, motifs, textures, loops, processes. Build events from these, sequences, liquid stories. New game object? New story. Composition will need to happen so frequently and quickly, it would be good to develop an improvisational relationship to it, being able to compose without stressing about doing anything well, just playing in whatever the most efficient and fun way might be. Not a full orchestra, unless there's a well thought-out strategy developed to dissolve its unity. Want an orchestra? Whatever MIDI sounds should do you just fine, or use samples-- modules can easily be cut and shaped from existing recordings, and there's loads of music in the public domain filled with amazing sampleable bits. Don't let "it's too much work" be an excuse to not fill out music designs, just be lazier about it, automate the work, play it always. The content doesn't matter too much anyway-- it's how it moves.
To practice designing music in this way, more videos like the above could be made using the same technique-- music design without even having to touch code, like scores without a performance. At every change of state, we face interesting compositional decisions to play out, possibilities to navigate, movement in so many undiscovered dimensions. We could make games like this forever. Yes, You Can Make Games, but don't think you have to touch programming to do it-- just keep moving.
6 - Dissolving Composition, Instrument, & Notation in Play
When a soundtrack is subject to the variability of a game's mechanics, the music itself becomes a mechanic, an instrument-- music to be played. And the fluid space that houses this mechanic becomes a space for the play of instruments, a composition-- again, music to be played.
Spaces hold other spaces which in turn hold others, and so the hierarchical relationship between instrument and composition which says that the former is a component object used in the latter can be dissolved, reversed. Now a composition can be a component object of an instrument. The screen is the "page" displaying the fluid notations that allow for interfacing with the space-- notations which themselves are instruments built of compositions forming instruments, opening new notational dimensional-movements, and so on. This is a music space.
The space of all games-as-music is no less infinite than the space of all music itself-- in play, the two spaces are one.
>>>>>>
**************************
some good books for
******************
>> continuing fluid music/playspace research:
"Infinite Music" by Adam Harper is full of great stuff about music as object & space. The practical applications of the object-oriented music theory it describes are endless. Harper's blog post "Musical Radicalism Beyond the Sonic" is related, and it's about "music without sound," which could just as well be a description of the played time-structures of games-without-soundtracks.
"Chaos" by James Gleick is a great introduction to chaos which a lot of people have read, but if you haven't-- it's a window into lots of inspiring ideas about self-organization, great models for understanding emergent playspaces. In music spaces, the organization of objects requires some amount self-organization around the player as a chaotic agent-- played emergence. Some of the concepts explored in this book, like attractors (the swirly things which i used phase-space images of throughout) and state-transitions (i.e. solid -> liquid -> gas) seem like they might be useful structural units for shaping shifting gravities and tendencies of fluid possibilities that define a space. The book also introduces some ideas from topology, which is a geometry(ish) of elastic spaces in n-dimensions (like music) and thus likely applicable to all of this-- new models of dimensionality. Also part of the "Gleick's Chaos" brand-- this software, which supposedly works in dosbox, but I couldn't figure out how.
And-- Gilles Deleuze-as-playground: start anywhere and swim, movement in the spaces of motion-image/time-image, plane of immanence, nomadology, smooth vs. striated time, the actual and the virtual, difference & repetition-- concept-modules in an alternate theory of play-as-movement that values the always-now of forever-change over controlled behavior governed by false belief in the fixedness of objects. -- As chaotic agents in the played systems we're describing, the need for an ethic of creativity and movement emerges, and there's a project here to discover one in play--
About this-- from the preface to Deleuze & Felix Guattari's Anti-Oedipus, Michel Foucault writes:
"[one is led] to believe it is all fun and games, when something essential is taking place, something of extreme seriousness: the tracking down of all varieties of fascism, from the enormous ones that surround and crush us to the petty ones that constitute the tyrannical bitterness of our everyday lives."
others?
>
Friday, August 10, 2012
@-dance w/EXO \\ Tabor Robak & Gatekeeper
EXO just came out. Download-- it's FREE. A 35 minute game by Tabor Robak, set to the album of the same name by Gatekeeper. It's part of a dispersed visual project-- the album artwork, the game, and a font.
Robak says (quoting from this feature):
“Everybody’s making music videos, so it’s time to figure out what the next thing is [...] I think novelty in general is a universally good force that should always be pursued. Newness [...] There’s a real saturation of [audiovisual] work. This idea was a way to set ourselves outside of that a little, with a new thing that didn’t already have a set of established ways to judge it.”
EXO continues the evolving tradition of designed musical playspaces. Recent excursions by popular electronic musicians into the form-- Brian Eno's Bloom, Bjork's Biophilia, Oval's ovaldna player, etc. Also, the broader tradition of flexible music in general, like improv software by Anthony Braxton, George Lewis and David Behrman, game pieces by Zorn, Cage of course.. notations (Beck's forthcoming "future of the album", sheet music)
It also continues, maybe unknowingly but still more directly and self-consciously, a notgames DIY-realism trend exemplified by thechineseroom's Dear Esther and Tale of Tales' many games, with their preference for detail in content over that which emerges from mechanical variety or process-intensity. And the broader tradition of Hollywood and the AAA games industry, who we inherited these values from (teal & orange).
Not surprisingly, some things in Exo are unique and exciting, others not so much.
It's visually enchanting. Vibrant palettes coloring a wide variety of future-primitive environments from digi-space scenes to deserts to oceans to floating islands and Bioshock-esque jungle-hallways with screens.. lots of melting and spraying and pulsing. The album's PR blurb describes the game's attitude well-- "Pineal activation. IMAX phantasy. Drippy acid ecosystems. HD... everything." Cheeky psych-corporatism via techno-capitalist realism -- Hi-fi is the new underground.
“It’s definitely a response to the popularity of lo-fi five years ago and also the proliferation of affordable high-definition technology,” says Robak. “Everybody’s got high-definition TV. The basic MacBook now is a pretty good computer [...] What HD means to me [laughs] is a commitment to quality and a level of detail.”
To produce some of this detail, Gatekeeper have revealed that they used Hollywood sound effect libraries for the album, those meticulously designed sounds that fill the whole frequency spectrum so elegantly-- these sounds that used to be the exlusive property of money, and now they're READY-MADE. Robak, likewise, says he uses texture/object packs to skin his virtual environments (Rhizome profile). In the culture of games, we're made to believe that a visual spectacle of this sort requires heroic bunches of money and man-hours. Exo asks-- why not just sample and process, reuse?
So, it looks-- and in play:
Robak has directed music videos in the past, and the rhythm of movies seems to have had an awkward but not totally negative impact on Exo's qualities as a playform. It's an "exploration" game, but one in which we're automatically "cut" from space to space every minute or so, like in a strange dream or travel documentary, no sense of connectedness between the environments.
As a viewer, we're kept engaged for the most part. As a player-- no longer any sense of agency in the spaces aside from the forever-moment of motion itself, moving and looking. This is the most recent of what Baiyon calls a "just walking game". And once we accept the value-space of these minimal mechanics, we move on and into them.
At this point the game becomes like a dance. Once we get used to the strange rhythm, the arbitrary force of transportation becomes like a partner for us and we're freed to experience time as time, space-as-time now limited from the top-down. That is to say, the sense of discovery in an environment is a kind of temporal installation of event-signposts and a way in which we recognize space's temporal dimensions. In EXO we more or less hand over control of discovery to Robak.
There is strangely a greater sense freedom here compared to, say, Dear Esther, which is set in a large connected space, but which also limits spatial movement with the comparatively manipulative device of the path (explicit and implicit, we're told what to do rather than just being given variable control in a constrained space). Gone is the possibility of discovery-in-space, and so, again-- discovery happens in time. This is like the experience of playing music: every key press and movement of the camera must feel meaningful, the motion itself, or we'll quit.
Now, the play grew tiring for me about 15 minutes in. The music is exciting, but its intensity is overbearing when sustained for so long in an environment that doesn't listen too closely. The tension between music and play is interesting for a while, but it ultimately falls into a pattern of predictability and unresponsiveness. We're no longer dancing with but at.
This is related to another experience I've had with Gatekeeper. There seems to be a nasty trend in parts of culture, particularly in fashionable clubs-- dancing AT the spectacle on the stage, everyone facing the same direction, and not moving too much, lest they knock into someone or look improper. This is what it was like when I saw them live a few months ago. It's a disappointing way to listen to dance music, which asks our bodies to become one with the space, sounds, and with each other. We're confronted with images and we've been conditioned by them to look forward and submit-- even when we're in music, which is all around us.
In Exo, what starts as an interesting tension between the fluid and the fixed, play and cut, becomes tiresome once we've gotten used to its repetitions. If the rhythm of the cuts was more variable, maybe this would have felt different, or maybe even if the static music track itself changed more.. admittedly, there's a redemptive climax at the end during the final track, a quick splashy recapitulation of all the spatial motifs, transformed, melting now. But...
Variation, change, dissolve-- these things are missing in the structure of the playspace for the most part. Structural elements: transition-forms, speeds, object properties: our own variables, assets, must be given over to the same process of flow and re-use to which Robak and Gatekeeper have subjected the ready-made assets of the cultural commons in their sampling. A psychedelic realism, of process and change, hinted at in some of the moods here, must replace the object-obsession of capitalist realism/psych-corporatism that we're given instead.
One direction >> For a just-walking game: WALKING SPEED is the fundamental variable source of emergent rhythm, along with look-speed. It determines how quickly objects move on the screen-- as they grow from small to large and move past us, a visual pulse is established. Walking speeds change in EXO, and occasionally they feel right, but they tend to be too slow, working neither with nor against the rhythm of the music, but again-- at it. //
And finally, Exo as music game:
The soundtrack's implementation is static, suffering from the same alienated attitude to the relationship between music and play that we've come to expect in so many of these pop-game projects, like Pitchfork/Killscreen's recent INTEL Soundplay stuff, that assume a fixed soundtrack is enough. The guiding question here: games function like music videos? As a simple answer to this question, Exo works. It's the dance idea-- we can dance even to music that doesn't bend to our wills, right? True to a certain degree, and in many ways I enjoyed the direction of freedom in the game more than I did the live performance (and both as dances).. but something is lacking...
In successful engaged-performance, musicians have always responded to the energy of the dancers-- there is a feedback relationship here, as there is between musicians playing with one another. Feedback is a structural necessity in meaningful music-making. In fixed media, like a music video, the feedback relationships have been frozen, contained to static values in the forms themselves, and they leave us no affordances to further engage them (though they're playback mechanisms do so). The production of such forms involves feedback between audio and visual information, moderated by our own desires, and this is something we've become pretty good at.
In open forms, where dynamic variables are in play, to neglect to allow the sounds to take part in that variability (which we've already become pretty good at doing with visuals) is a mistake, and a common one. As a tension, it can be powerful, but there must be a release-- an expansion to counter the contraction-- if there's going to be any movement toward the space of harmonies of change.
Automated musical change is possible here, and it will be useful. Sounds tied to spaces and events and processes, allowing us to engage in play once again with our music. The process isn't too difficult, in fact just a continuation of that bricolage and coding work that's already been started, now using variables to control musical parameters in real-time. It wouldn't be difficult to cut the album tracks into loops and event sounds, 303s and beats and hollywood sound effects, game events triggering playback, volumes changing, maybe pitches, too. Already-- a whole new world of possibilities, and we're only beginning. The spaces themselves will need to be musical of course, and the music spatial, liquefying those distinctions-- but this isn't an impossible challenge by any means, and both the spaces and music of Robak/Gatekeeper are already inclined in these directions.
This edit of Exo (sounds only) is an example of how samples from the album could be repurposed for use in a highly dynamic playspace. It was made with only three processes: cutting samples (changing start and end times), pitch-shifting them, and rearranging them in a layered, multi-channel space.
This edit of Exo (sounds only) is an example of how samples from the album could be repurposed for use in a highly dynamic playspace. It was made with only three processes: cutting samples (changing start and end times), pitch-shifting them, and rearranging them in a layered, multi-channel space.
We can imagine that each chunk of audio in the picture (which is the pre-mixdown arrangement layout of the soundcloud track above) is triggered by a game event, either in play or automated, and that this particular sequence was only one of many possible realizations. Deciding how the start positions and pitch-shiftings could be determined by game events would be an interesting space to work in. And this is without manipulating volume, even, or having access to component objects, like solo 303s or sfx or hihats. There are a lot of possibilitites. This example is a very simple design of what things could be like.
>>>>>
Hi-fi is the new lo-fi, and this is a gift to the commons-- the continuing project of opening ourselves to everything as a material... a gift-- so long as it doesn't stay put. Fashions come and go-- this sound as a "now" thing will be gone soon, but the trajectory along which it's a point will stay in motion.
The sooner we get to the point of seeing/hearing things for what they are rather than what they're trying to be-- the better. All sounds as the space we're playing in. All images and structures, too.
Exo brings us face to face with tensions that have the potential to lead us in this direction. Keep moving. When we can play Dear Esther and see that it's greatest charms are in its imperfections, an uncanny-realism with proudly-virtual spinning sprites-- then we've begun to arrive at the right place, an awareness of the actuality of form.
When HD has become easy, ready-made, how does professionalization defend itself against the amateurs, bricoleurs? It can't-- ultimately, this is the project of the dissolve of the object and static values, becoming an infinite space of pure possibility and motion for us all. Again-- as long as we stay in motion.
Saturday, June 16, 2012
Played Meaning (Concerning the Spiritual in Games)
0
There has been talk recently about the word "game" and what it ought to mean. Some would like it to mean something very rigid, like Salen & Zimmerman's definition: "a game is a system in which players engage in an artificial conflict, defined by rules, that results in a quantifiable outcome." They see a value in this tradition. Others would like the meaning to be more fluid. By comparing the above with even just one more definition, Roger Callois', "an activity which is essentially: Free (voluntary), separate, uncertain, unproductive, governed by rules, make-believe", we can get a sense for the amount of necessary "tradition" that's actually at stake here-- almost none. These meanings are fluid, generative, subjective.
Now: a game is something that we play. A videogame is a digital playspace.
Why can't we use another word to describe playspaces in general, and thus preserve game's goal-oriented meaning? Because we are content with using the word "videogame" to define this form, at least for now. And videogames aren't even games in the "formal" sense of the word. They tend to be composite forms. Of what? Activities, toys, instruments, sandboxes, etc... ("games", too). Our intuitive understanding of what a videogame is and can be has eliminated the usefulness of game's sanctified definition in our present circumstances (whether or not they qualify as "games" in the formal sense, SimCity, Electroplankton, etc. certainly qualify as videogames). "Game" is also now used as a convenient shorthand for videogame or computer game, and other playspaces that resemble those. What we used to enjoy calling a game (i.e. Salen & Zimmerman's formal definition): Shawn McGrath's new term for this is "fucking game." "Math game," or "competition," or "school" are other possible alternatives.
A game is something that we play. A videogame is a digital playspace. This is the shape of games to come. To impose stricter definitions will only serve to stifle creativity and unnecessarily celebrate past trends in favor of present and future possibilities-- this is already happening.
If these proposed definitions are so broad as to include everything, and now everything is thus a game, then let's play everything!
1
There's been talk about games and what they mean and ought to mean.
It's not possible to make a meaningful game. Likewise, it's not possible to make a meaningful song or picture or story. Meaning arises from our interactions with these forms, from how we play them. (It is possible to make a good game-- focus group testing is helpful here. Goodness is not great, though-- it's useful; it works rather than plays; this seems to describe the bulk of most design processes).
Games with a didactic quality like Jon Blow's Braid can fool us into thinking that meaning is a thing that is being created and then handed down to us-- the intensity of the implied value systems that come packaged in game designs are often mistaken for the meaning itself. Sometimes our perceived meanings line-up very neatly with what we're told are a game's intended meanings, and this can feel good, but such an effect is incidental rather than essential in any way.
It's not possible to make a meaningful game, but all played games are meaningful. Meaning can be generated but not located. It's a process rather than an object.
Certain boundaries in a playspace will encourage certain types of play, and from these, if they're played intuitively and honestly, we experience the intensity of this thing called meaning. We then sometimes attribute this meaning to the creators of the game, and this is wrong. We can thank the creators, but we need to respect our own subjectivity (though to then thank ourselves would be foolish-- can we learn to thank the play impulse that somehow exists both inside and outside of ourselves?)
2
The relationship between music and videogames is not a rhetorical one, it's not just an analogy-- the language describing it may be, but the various identities are a fact. Structurally, there's little the two forms don't have in common. This has design implications-- rhythmically, formally, texturally, etc. Most importantly, in practice, both music and games are played-- and can be played in very similar ways.
Musical instruments are games, as are compositions. They are possibility spaces with boundaries implicitly or explicitly inviting certain types of play.
Videogames are not competitions by necessity, they are play-spaces. Play is the subject and the source of meaning. How do we play? The kinds of meanings that exist in music are the same kinds of meanings that exist, fundamentally, (but lying latent), in games-- they don't point at anything but the experience itself, at the materials and interrelationships that form the binding structures of that process.
This kind of meaning, and how it doesn't point at anything (it just is), is the reason why some people call music abstract. But music isn't abstract. Meanings that point (signs --> signifieds (words, narrative, realism)) are abstractions, divisions/boxings, of reality-- they necessarily leave a remainder. Musical meaning doesn't box anything and thus encompasses everything. Musical meaning is concrete. (The social/contextual meanings in music, what Adorno calls the "historical", point away from this toward a more linguistic system of signs. But this system, too, is fluid. Remember: we've all only ever experienced, and are continuing to experience, one piece of music (our own)).
There's a relationship between musical meaning and mathematical meaning-- at it's most basic, harmony (pitched and non-pitched) and its foundation in simple arithmetic. These identities become more vivid (in our minds, at least, if not our ears) when we study scores and consider those sets of instructions as the music itself-- this is how schools like to teach music, as a kind of math game. Computer programs are complex sets of instructions (scores), and it will be helpful to apply kinds of thinking gleaned from score analysis to game creation-- systemic approaches to harmony, rhythm, texture, etc. are useful tools. But the score is an abstraction, and when we try to live in it, almost all of music's essence is lost. From John Cage: "Mathematics enables us, it seems to me, to think about, say, water-- without jumping into it" (video). The experience of music, and its essential meaning, comes from our jumping into the water.
To explore these meanings-- forget narrative and forget "game design." We'll study music-- rhythm, harmony, contour, texture (and allow ourselves to freely identify these qualities-- to apply them to colors, motions, touch). We'll play music, listen to (play) music, and allow ourselves to question what music means in these contexts. We'll see music, and touch it, too, and live it when possible. Music is not a form-- it's an ethic of sorts, a way of being. It is a fluid answer to the question "how do we generate meaning in the play process?" How do we play? Competitive games have required the player's submission to an imposed set of values governing their ideal actions-- when we are no longer governed by such rules, how will we choose how to act? Again, John Cage (via some others): music's ideal function is "to quiet the mind, thus making it susceptible to divine influence."
3
Meaning-making in instrumental play (goal-oriented-- a value system forced on us by competitive games) is inherently and necessarily at odds with meaning-making in musical play. Though-- the two categories are not opposites. Instrumental play is goal-oriented; maybe the opposite of this is free play, which is something like an unreachable utopian state (or a Temporary Autonomous Zone?). Musical play describes a way of being that seeks love and identity with the world and its boundaries (to push up against these boundaries, to know them, and try to to break past them)-- its precondition is sensitivity, but nothing escapes its sense of possibility. (The most vicious sentiments might emerge from playing musically. Anything. Such attitudes might grow more intense or might be followed by a release of tension and subsequent transition into a state affirmation and tenderness-- the possible forms are endless).
Notated compositions (and plans for future music-making in general) are a series of instructions, boundaries that we then play in. They are not music in the truest sense. Musicality playfully emerges from these boundaries, in affirmation of and tension with them. And it's this emergent spirit that is the essence of musical play. This spirit has no bounds. The Fluxus scripts, happenings, and other participatory arts of the 60s took a radical kind of musicality and played with it in new boundaries-- physical space, conceptual space, etc. (these, as opposed to the kind of aural space that music creates). Musicality requires a kind of openness, a total presence in the world, being here now. This openness is the foundation of all musical play.
4
The boundaries of competitive structures exist in direct conflict with our impulse to play musically, and yet, through this tension, such forms can point toward unique musical value systems. They will be fierce. The "guerilla tactics" in Zorn's Cobra are a good example, an aggressive transfer of power and a rare example of competition emerging from musicality, instrumental play contextualized as an exception rather than a given.
Rich competitive structures are considered holy by many game designers and players. And, it's true, competitions can reveal amazing seemingly endless vistas to our senses of possibility. This openness points toward the divine. Then-- the feeling shuts off when we realize that the possibilities can be ranked by order of their usefulness. We will be more likely to succeed if we behave in certain ways. The problem here is that the conditions of success, and sometimes the methods for achieving success, are pre-determined by the game's design. The game imposes a value system on our experience. The divine impulse can remain intact only if we're always open to our inner sense of infinite possibility (which will mean entertaining the less "useful" possibilities). I've read about Go masters that maybe play like this, and Bobby Fischer searcher Joshua Waitzkin describes similar states of mind in his book "The Art of Learning"-- it seems that along with mastery of a rational craft comes the confidence and ability to let rational things go, and to live intuitively. In life, we can choose our craft, and this choice can constantly be renewed; in competitive games, not as freely (except insofar as our experience of choosing and living in the game is an extension of our played experience of life).
Competitive play channels creative force but to an end other than itself. If our love of a process (a craft, a game), compels us to move in a direction other than that in which the game points, we encounter a barrier, and since we have freely chosen to play, we will now choose to stop, and will have chosen suicide in the play space. Of course, we're not forced to choose this way, but to choose otherwise requires a respect for and love of the game (a respect for its imposed values and a love of the experiential aspects of the playspace).
A utopian state of play: all possibilities are ranked as highly as possible; each, when chosen, introduces an entirely new set of possibilities, each of which is also ranked as highly as possible. In this setting, the word "ranked" loses its meaning; infinities open and give way to new infinities, and so on. The life of the game is the life of the spirit.
5
If we're going to admit systems of ranking into our games, to construct goals, their design should come from an intimacy with the materials of the playspace as a freely-played space, meaning one explored through our own self-directed (and constantly dissolving?) goals; these goals should invite us to play with processes that direct us toward and help realize our vision of inner utopia. This is the end to which goals should be a means: a final played application outside the structures of competition. It's, in part, to a celebration of particular strong values like these that we can owe the creative triumphs of games like Way, which invites us to create simple languages and then destroy and recreate new ones in a final double-coda, Minecraft, which allows us to explore the conceptual wall between nature and culture, Mario Galaxy, which teaches us how to dance with all the world as our partner.. etc.
There is nothing inherently wrong with explicit goals and the instrumental play they call for. What is wrong is the widely-held assumption that these kinds of barriers and motivators are essential to the form of games.
The essential meanings in games (in play), function at a lower level. If we start from an understanding of games as musical objects/spaces, instruments for self-exploration, our intrinsic attraction to explicit goals (as boundaries that describe ways of playing) diminishes, and we see that we can (must, even) start from nothing, from chaos. From here, we search and listen, and if our love of a system compels us to teach others particular ways of playing via artificial boundaries (rules, which can be broken-- the more fundamental boundaries cannot, they can just be pushed), then we should act accordingly. These goals emerge from love.
6
The question of how games and play generate meaning and how they can be made more meaningful ultimately points in the direction that all such questions must point: toward truth, the divine, the world/universe, god, tao, the eternal, infinite, spiritual, whatever, etc.-- absolutes (that, yet, may be anything but absolute-- impossible to place, constantly changing). The simple "how" question ultimately wants to ask, before it has become too useful and too realistic: "how can games and play be the most meaningful that they can be?" This is a question of values, and it can be answered only in action, only when it's truly played-- when it's a natural continuation of the divine impulse, that perpetual motion, unfiltered creativity.
How we choose to play and find meaning in what we play-- these are fundamental questions. We're on a search for particular (fluid) ways of playing-- tactics that might further our search, that might point us in the right direction (all directions?).
And what we play? (we are what?)
And what we play? (we are what?)
Competitive structures have had, and will continue to have, many things to teach us (at best-- about valued/loved play processes), but they lack a particular kind of realism that's wanting in our games right now-- playspaces that, as in life (though very differently), allow for the full flourishing of our creative faculties, the active exploration of shifting possibility spaces and the intimacy with the materials that form their boundaries.
Musicality as play-within-constraints can reveal for us ways of playing more fluidly, of opening ourselves to the world and to that infinite sense of possibility at every moment.
Now, as players, we'll need to learn to bear the burden of generating our own meanings. And as designers, we'll need to bear the burden of imposing implied values (if not meanings) on the player with our boundaries. We'll open these forms and gladly hand over certain variables to the player because we know that it's not particular values that establish meanings, but the dynamics of change that generate them.
//
//
Saturday, May 5, 2012
Thoughts on Journey & Way
I didn't get to play Journey's mutli-player aspect, and I'm not sure how much I'm missing because of that.. lots, I'm sure. I did play thatgamecompany team member Chris Bell's Way, though (play it!), which seems something like a relevant substitution. For me, much of it's meaning emerged from the two rapid shifts of possibility space at the end: the initial hop-around meetup and the map/chalkboard denouement. One after another. The first change-- the effect of being in an entirely new situation with someone (or something) we've only ever known in a particular setting but have gotten to know very well there; the languages of precision we've developed up to that point give way to a more fluid language of dance/gesture (a language developed further in Journey). Then, a repetition of the effect (of change) initiates a new state of things on a higher level, change itself as the new constant, the situation as a variable, a fundamental kind of rapid un/re-learning, a destabilization pointing toward a continual dissolve and rebirth of possibility. This affects how we play, and the played end is a very beautiful thing, indeed. The puzzles, the learning we're involved in for the bulk of the game, they're fun enough-- but it's what they're preparing us for that gets to the real heart of the matter, a shared sense of shifting possibility, our subjectivities as the only constants in an otherwise variable space. When this is felt, it's profound. From the sequence of events I played through in Journey's single player game, it seems unlikely that any similarly designed re-contextualization of relating with an other has been suggested (though, of course, so much more than what's suggested will emerge in play-- for now I can only try to imagine the dances).
2
When I started Journey, I looked around and figured it was an exploration game, and I set off in some direction other than that of the mountain which we are implicitly asked to head towards. When I found myself stuck, trying to force my way up too-steep a sand dune, I felt let down. From here on out, I redirected my energies and intentions toward achieving the goals the game had laid out for me-- my playing became instrumentalized.
The game is a series of playgrounds stitched together, each with one entrance and one exit. Some playgrounds are more liberating than others. All of Journey's are embedded with values asking that we eventually rank our possible ways of playing by order of how well a given action will help us find the exit. We are free to stay in the spaces for as long as possible, and this is occasionally a stunning thing, but at other times they don't seem to be designed for such use-- rather more like giant versions of the aisles of Ikea, which ask us to move in one direction, to see everything along the way (and to hopefully find some beauty in these spectacles), and then to check out.
Like Super Mario Galaxy before it (one example among many, I'm sure), Journey rewards our discipline and obedience with a wealth of movement-treasures. At it's best, it opens some new directions in videogames as digital ballet. Gardens of carpets and scarves that give us the power of flight are lovingly arranged in ways that suggest particular choreographies. Upward motion, climbing the little nodes of possibility, each hop a meaningful thing. Falling, recovering. Dunes as ski slopes, etc. All of this-- rhythmic fluidity. A lot of this meaning is a kind of touched meaning. The variety of the terrain, how the game's responses to input change accordingly with our navigation of the physical environment, how possibility shifts on that level. That's the essence of Journey-- these little details, the procedural manipulation of key variables between input and output (this is what feel is, I think?). Timbre. Like a musical instrument, a system of tight feedback loops, a tool for exploring possible meanings in time.
And yet, when we get into these intimate systems at a low level like this, and really learn to love them, to let touch teach us something-- when we've finally become comfortable collaborating with the game in the process of generating our played meanings-- it's difficult to not contrast the joys of that kind of emergent experience with the grander, yet more contrived, spatial/narrative ambitions of the game. That we're told this is a journey, a meaningful traversal of space-- we'd expect from this a generation of meaning on a higher level, too, a valuation of where we begin and where we're going to end up. But it doesn't emerge, because of the imposed top-down design. We follow the path, the string of playgrounds. Our sense of possibility is far greater than our space of possibility here. Play that emerges from the bottom up in strength/abundance naturally wants to ascend, to rise up all the way into space, to become a dancing star. The play impulse leads itself , in dialogue with the environment, but not with the environment as a static thing; rather as a musical thing, a living thing. A world more than an environment. Spaces designed from the top down impose a limit, an atmosphere. This is inevitable. Not to say that there's no place for limits imposed by top-down design. Rather, the function of these limits should be a declaration of radical values, a means of breaking the tyranny of habit, to encourage a new kind of play, more true/beautiful than we might have discovered on our own.
Journey is a spatial exploration game and yet our greatest freedoms are still constrained by the closed boundaries of a bead occupying a particular place along a string (maybe a stick is more accurate, less malleable). It's a mechanical exploration game (insofar as touch can be explored), and yet we're not given the openness that's a necessary foundation for the free association of our played impulses. Let's melt the beads, explore their topological equivalents, allow constants to give way to variables. That would be an exploration game. The string can still be used, of course, but let's use one made of rubber. Or, instead--let's tighten the string, and shave these beads down to their most essential qualities, Mario Galaxy's strategy. No time wasted, constant imposition of atmosphere from the top-down. We'll let things melt, but they'll always bring us someplace new, and quickly, too. This will be more work, but it'll also be more play.
For now, though, this is what we have, and we'll play here if we're compelled to do that. I'm torn. I want to play with the raw materials of the space and situation in whatever way seems most suited to continuing my ritual of focused presence in the moment, my flow, and this necessarily leads me in unpredictable directions-- how could it not? But then, I also recognize the power of the rewards I'm given when I follow the rules..
3
Possible directions for future research: observing the variables in a space like this which erect the boundaries of possibility, how they change over time, how they're determined by geography and player actions, etc. Even on the lowest levels, games are (unknowingly?) creating beautiful pieces of tangible music (whether audible or not, usually the latter). To dig into these changes (the source of musicality), to explore ways that change itself functions as an expressive device. Maybe we can learn some important things from Journey at this level. And beyond this, to trace the trajectories of subjective desire at a low level, and to create spaces that allow these impulses to flourish; spaces designed for the motivic development of actions, spatially/temporally augmented, the smallest seeds growing into the tallest trees. And to really understand that smallest seed, to touch its vibrational qualities, we need to design musical interactions at a low level-- these are not the modules of a composed block form, but rather the variable pressure and angle of a finger depressing a string, or mouth blowing a reed, etc. Once we can hear the seed, we'll really feel it better, it's output will touch our ears, and to start with this, we'll be hardpressed to go on designing against its own touched inclinations.
Friday, May 4, 2012
Dissolving Musical Space
(drawing in Alchemy)
In playing music that hasn't been designed, and in forms of music that have been designed to be played-- we, the subject, & our materials, our objects, begin the process of dissolving into one another.
Free improvisation, music that hasn't been designed, is an example of this dissolve. The self into the instrument, into the group, the situation. Improvisations can surf the dissolve, prolong the dynamic state.
But forms of music? can dissolving spaces be designed?
First, can musical spaces be designed?
Folk forms, musics that we play, create spaces like these. Music designed to be played.
We start from the uncountable multitude of aural traditions. Convention. The gradual systemization of loose form.
Infinite possibility giving way to shaped possibility.
We start from the uncountable multitude of aural traditions. Convention. The gradual systemization of loose form.
Infinite possibility giving way to shaped possibility.
Notation can help serve this function-- it communicates possibility spaces to audiences with a read/write literacy of its system. Scores in general-- visual, verbal, etc.
These are, at their best, guidelines rather than directives.
But scores aren't for everybody-- they're for musicians, for artists, and they thus ignore that important observation, that "an artist isn't a special kind of person; rather, every person is a special kind of artist."
Professionalism breeds work at the expense of play.
Start from what we have.
Now-- recordings rule over our musical landscape.
They have become the new "scores," directives, which all too many live performances seek to reproduce, and lives seek to live in harmony with-- mechanically, reproducible.
These are, at their best, guidelines rather than directives.
But scores aren't for everybody-- they're for musicians, for artists, and they thus ignore that important observation, that "an artist isn't a special kind of person; rather, every person is a special kind of artist."
Professionalism breeds work at the expense of play.
Start from what we have.
Now-- recordings rule over our musical landscape.
They have become the new "scores," directives, which all too many live performances seek to reproduce, and lives seek to live in harmony with-- mechanically, reproducible.
There is an intimacy with music that has been lost in our shift toward listening to recordings,
A diminished sense of possibility. Read only.
An object rather than a process.
Toward the impossibility of systemic intervention, pure spectacle.
An object rather than a process.
Toward the impossibility of systemic intervention, pure spectacle.
But not quite-- we know, at the same time, that these recordings open up new possibilities.
We know we can use them.
We know that in some situations we can start & stop them, and we then begin to rediscover that current of musical play. Can we also stretch? isolate? invert? transpose? To the whole? To components? The threads making up the fabric?
Melting constants: variables.
A recording is a thread. A component-- but of something new.
The material of the recording is a substance to sculpt with.
Sampling? Yes, but only as a process-- not the object that it produces.
Synthesis, similarly. The materials of computer music, searching for a new open future where all participants are players.
Imaginary landscapes-- now melting to our touch.
Imaginary landscapes-- now melting to our touch.
Music as a Tangible Process rather than Gradual Process.
An instrument, a composition, a playspace.
Product as raw material-- the dissolving of recordings, of all things.
A new kind of open form, to discover a fluid architecture of musical space.
And to play out existing architectures, to dance to them.
From these dances-- a shifting form, born of the dissolving self.
Thursday, May 3, 2012
Silent Play
4'33", John Cage's famous "silent piece", is a kind of aestheticized proof of the non-existence of silence. The performer is asked to play through three movements, each with one instruction: "tacet" (meaning "remain silent"). At this point, the sounds in the environment become the focus of our attention-- these sounds will always be present, there is no silence. More than an ordinary piece of music, it resembles a ritual, a spiritual exercise in self-restraint and openness to the external world. Cage always talked about the piece as something he played regularly, in all kinds of different situations-- in the city, on the beach, wherever. Perhaps more than a "piece," it's a whole-- a way of being.
I've had some of my own powerful experiences with it. I remember sitting in my backyard a few summers ago, listening to all the traffic go by. I'd recently been reading a lot of Cage's writings, and I was listening to all of this as I would listen to music. I was just becoming interested in response structures, cybernetic relationships of a kind in all sorts of music-- call and response, chain reactions, loose pulse, etc. This kind of systemic thinking had a profound effect on me, and my experience of the traffic system's dense counterpoint heightened my sense of presence in the environment-- in a way, an awareness of myself as a subject in an endless participatory system, an identity with external forces that behaved the way they did precisely because of my own action (or inaction). If I'd felt the nihilistic urge, I could have gone into the middle of the street to cause an accident (/death) and all the rhythmic and textural changes in the music that would come with that. Cars crashing, bodies squishing, sirens arriving, etc. Xenakis' Formalized Music describes a similar situation..
So, in the right state of mind, the silent piece, which is really a kind of play tactic, can help us uncover new dimensions of this fundamental ludic (playful) message: non-action as action. Contemplation as play. It's a way of being that's rarely encouraged (or even allowed, thanks to time limits and other deadly forces) in videogames, games in general, and maybe this is unfortunate. Still, to be silent (still)-- it's a freedom we can never really be denied. It's an often ignored outer bound of our inner/psychological possibility space deserving of serious exploration. If a reason we play is to seek a kind of identity between ourselves and the materials we're engaged with (and this is a necessary precondition of any spiritual play process), silent play is a way of letting the space be itself on its own terms before engaging with it. Confucius said something along these lines.. "if I am going to play music with another person, first I will sit in silence, and listen to them playing by themselves. Then I will join in."
***
Now, to respond to the above video, a performance of 4'33" in Level 1-2 of Super Mario Bros. (SNES All-Star version) -- Imagine the game is now more aware of our silence. How long it's been since we last pushed a button, and what that button was. If the button was "A", the room gradually begins to grow when we release it. If it was B, the hue of everything on the screen shifts, cycles. The speeds of these processes are determined by how long the button was held. The goombas, too-- if the last button was A, they'll jump in a rhythm based on the time relation between that pressing and the previous pressing. If the button was B, they'll turn into fish, and suffocate-- the speed of their death is determined by the size of the room. The lights grow brighter as they die. If the last button we pressed was the down arrow, water will begin to rise (and again, its speed is variable). The color of the room determines the speed at which which we move through the water, it's resistance, or "feel". And in the water, when the feel is right, we too might become a fish.