Expanded Media Performance Night 16/10/2009
6:30 opening reception in atrium
7:00PM Begin Show in LT1
8:00PM continue program in Media Lab
9:00PM finish program in LT1
“As a composer, I feel that visual elements, organized using structural techniques commonly associated with musical architecture, provide exciting possibilities for conceptual exploration” – Frank Zappa
MDDN 311/Expanded Media is an investigation into new forms of digital media production and post-production techniques including: non-linear narrative, audience interaction, stereoscopic environments, and real-time graphics. MDDN 311 addresses the need to explore emerging forms of production and post-production techniques through experimental audience engagement. This course also utilizes the cutting edge facilities of the School of Design Media Lab to produce works that expand the role of screen-based work to include time, space, location and audience factors.
http://softwarefreedomday.org.nz/
http://www.ubuntu.com/ - open source operating system
http://www.blender.org/ - 3d modeling, new version coming out soon
http://en.flossmanuals.net/ – open source manuals, blender included
http://dynebolic.org/ – pc, cd boot operating, linux, comes with a heap of software
Download and read this article about Live Cinema for discussion next week.
http://www.solu.org/text_PracticeOfLiveCinema.pdf
as well this article below is very interesting
http://www.washingtonpost.com/wp-dyn/content/article/2005/06/22/AR2005062202394.html
Introduce Concept
Select from matrix
Break up into groups 30minutes to make a plan
Groups shoot for 1 hour.
groups return to capture and edit.
Create three 5 minute videos as pool of content that will be used in class on Thursday to create a collaborative remix.
Post Production Interventions:
Groups must do something that cannot be accomplished by shooting. This could include, composting, motion tracking, motion graphics, real-time quartz recording, etc..
Class Exercise
This exercise will be over two in-class sessions. you will go out with a theme, film it, post-produce, sample and prepare for a live mix. The idea is to take an experimental concept, and run with it to create a quick body of work. Split into groups of 4, divide the team into roles, ie. things that need to get done during production and post-production. use what you have learned through Quartz and After Effects for remixing.
Monday is filming and prep, Thursday will be the remix. Both these classes will be a live hand-on exercise, to get from idea to final output.
Interaction as a Performance
Start to think about the relationship between the controller, performer and the content. What physical actions can be ‘performed’ for the computer to see and the software to interpret?
Precedents
Sensors/Interface/Software
All the information will be available in more detail on the Resource Drive.
Arduino
The arduino is a device to manage inputs to the computer that go beyond the usual inputs of keyboards and computer mice. It is great for managing multiple buttons, control, sliders and sensors. These new inputs can either be digital or analog. See arduino.cc for a website reference on more information. For arduino to MaxMSP go here. Jaycar is a great resource for any electronics you might need. Breadboards will allow for quick prototyping without the need for soldering, but it should only remain as a prototype, where the final configuration is then soldered together.
Connecting to MaxMSP
The arduino patch to be used is the one from the website, download V4. You will get a couple things, the arduino code, which you load onto the arduino, and the MaxMSP patch, which will speak to the serial code form the arduino.
When you start to build your patch, first things should be the arduino patch and FULLSCREEN. With fullscreen, remember to interpolate, or use the OpenGL Fullscreen from the Resource Drive for a much better result. An UBU-Menu object can be used as a much more efficient way to read a bunch of movies. Select the object, look at information and populate it with the folder containing your movies. Check the sample patch for an example of how to work an UBU-Menu. The numbers that are coming in from the arduino could be slightly erratic, so it is important for a clean result to slightly manage the values. Firstly the numbers should be scaled with a Scale object. The next object should be a Change object so that it only notices when a number changes, and it is not constantly calling the same number. For debugging your patch, use a fps object to view the frames per second, if it drops below 20fps there are some problems that will lag your performance.
Again, all these values can then be output as MIDI values, which can speak to Quartz Composer.
VDMX can be arranged in any combination and formats suited to what you are after for a performance. You can build your own, save it, and reload the same structure on another computer. It speaks really well to Quartz Composer, you can load Quartz files as clips or as effects. Look for QC under effects or just drag Quartz files into the MediaBin.
Quartz files can have inputs ‘published’ which will show up in VDMX under the Effects Control tab. In Quartz, you can publish inputs with an ‘Input Splitter’ object, where the input type can be set in the parameters.
Mediabin – Video clip source, grid structure, drag and drop clips from ‘Finder’
Layer Window – Set up multiple layers for compositing, Quartz files that need inputs will show up in the ‘Layer Control’ window
Effects Control – Published inputs from Quartz Compositions used for effects rather than content
MIDI Controlled – We will be discussing various MIDI controllers, which can all be connected straight into your VDMX interface. ‘MIDI Display’ in ‘PlugIn Manager’ will show you if it is activated. Any function in VDMX can be connected to a MIDI signal. :: Right-Click, select: ‘Start midi detect’
Project 2: Concept: Story/Structure/Content
Due Sept 17th
This project is divided into 2 parts, concept development and performance development, utilizing the mid-trimester break to generate and compile content.
The course outline for this project is available on the Mediazone site. Check the R-Drive for presentations and examples, this blog for links.
Start by identifying a type of performance you would be interested in, ie. VJ, Live Cinema, Expanded Cinema or Live Motion Graphics, do the research and start to incorporate some of this into your concept.
This project is really exploring a much more narrative based structure which goes beyond pure graphics and really places attention on the content.
Examples:
VJ
www.momothemonster.com
Peter Greenaway
Live Cinema
The Light Surgeons
The Pixel Addicts
Live Motion Graphics
www.sanchtv.com
D-Fuse
Real-time performance and composition is the key here, interacting with the work in a live situation. Think about how these works are different to pre-composed works, how the audience could know that this is a live performance.
How can the visuals become a vital component in a show, where the show would not be as successful without it?
See the Project 2 page for the project brief. Presentation and documentation are very important in this stage, it helps you to be able to discuss and present your project in a coherent and professional manner.
link–> VJing and Live A/V practices
from VJtheory.net
Read this article by next class for an in class discussion and post a response to your blog.