Sorry I’ve been slow to post latley. I’m moving to a new website domain. Once that’s ready, I should be posting more often with some more documentation.
Please continue to stop on by and I’ll let you know the new domain soon!
Pictures from when my table was on display for a few days. I have larger pictures if you want specific ones. This post has a lot of pictures, so if they don’t all load, you may need to refresh this page.
New video of the new system that loads and unloads applications. Also, the desktop is now sending out OSC message to PureData to create some sounds based on finger number and position on screen.
In such a short amount of time I’ve hit 1000 downloads! Well, actually it’s 1062 to be exact. Thanks everyone who has been testing and downloading the applications. Feel free to let me know how everything is running. I’d love to hear more feedback.
On another note, the table is about ready for display! It features 4 access points that allow people to load a menu where they can select applications to load. Many applications can be loaded and at the same time. Pressing on the desktop creates wind and glitch type sounds. There’s currently 4 other applications that can be loaded which include: Musical Wong (to be released soon), Musical Squares, Audioshape Sequencer, and MultiKey (half and whole keyboard).
Well, I haven’t been able to post everything leading up to this point yet, but I wanted to get the finished images up. I’ll be writing about the process up to this point soon so that there are no gaps in the “how to” of building my table.
New video showcasing the final table at work. The software is all a work in progress and new releases will be coming soon of all applications as well as new ones. If you like the video, please pass it on. If you don’t like the video, please pass it on anyway. Enjoy!
No, I haven’t forgotten about the other programs that I first started on. I’m still developing Audioshape Sequencer as well as Musical Squares, but recently I have made some big changes/additions to the MuliKey application. I think all of the changes are great improvements and will allows for much more functionality and experimentation within a simple application like MultiKey.
First, if you’ve seen the first versions, you’ll notice that the look has changed slightly. I’ve gotten rid of the background (for now) to allow for best performance. Also the border of the keyboard has changed a bit so that it is easier to resize the keyboard. Previously the border width made it somewhat hard to select the keyboard for moving, rotating and scaling. I think the little circle ends will help with selection.
You’ll also notice a tab on top of the keyboard that didn’t used to be there. This tab is a control unit. Click on the tab and controls will pop out. On previous versions, when a key was pressed the note would play until it hit the end of the sound file. Now, when a note is pressed, the note will end when the key is released. With the control center, you can control how notes start (Attack time), how they are released (Release time) , and their sustain amplitude (Volume). It is similar to an ASR or ADSR without the Decay (for those that are familiar with audio envelopes). There is also a control for switching between a few different sound libraries (synth keyboard, violin, overdrive guitar, and percussion) .
Also, now you can move, scale, and rotate the canvas (black space).
For those that don’t have a multitouch table, this application, for the most part, will now work with a mouse! It’s single “touch” this way, but you can get a general idea of how everything works, although it will be much more natural with multitouch interaction.
I feel these are some really great improvements, but I welcome any suggestions or ideas you may have. Feel free to throw out any ideas in the comment box and comment how you feel about the application.
Quick demo video using a mouse and the Multitouch TUIO Simulator. This is just a quick look at the different sounds you can get by changing around the new controls.
*Note: I’m including a .swf, .exe (for windows), and .app (for mac). Make sure to set the security settings so you’re able to connect to FLOSC if you’re using this with a multitouch table.
Audioshape Sequencer is modeled after Tangible Sequencer and originally inspired by Nicolas Clavaud.This application works with a mouse and/or multitouch table (touchlib/tuio simulator or other TUIO program). =)
There are three main things to know about the program.
There is the shape (square),
signal (transparent orange shape),
and sensor (Blue dot on square. Pink when activated).
How it works/How to use:
When a signal comes in contact with a sensor on another shape (square), it creates a “connection.” Move around the squares (by dragging or clicking/pressing) to create different connections. Same colored squares have the same sounds. Double click a square to play itself and it’s connected shapes. To rotate using the mouse, click and hold a square while using the “up/down” arrows on the keyboard. To rotate on a touch table, use two fingers. To make the signal bigger or smaller, click/press and drag the signal (orange shape).
Currently you can switch between two instrument groups (percussion and piano). The bpm slider controls the speed of playback.
Here’s a video of an older version:
Please let me know what you think and if you have any suggestions and/or problems. I welcome any feature requests!
Here’s some thoughts on future features:
More sounds library/multiple instruments at once on stage
Add/remove more shapes
Shape for rests so you can insert “rests” into the music
More shapes that perform different functions or have different signals
Sync On/Off toggle
Quantization
Volume Control
Currently, I’m only releasing the software. No source yet since there’s a couple things that needs to be fixed first. I am all still working on all my other software so expect updates soon!
Latency is a time delay between the moment something is initiated, and the moment one of its effects begins or becomes detectable. When it comes to projectors, latency refers to the time difference between the computer screen and projection from the projector. There will always be some latency (time difference) between the source image (computer) and the displayed image (projector).
Laurence Muller has a Beamer Latency Measurement Tool v0.2 that will measure the latency of the projector. Ideally anything under 20ms is really good. For multitouch, if the latency of the projector is high, there will be visible lag between finger movement of objects and the projection of these objects.
Here are the screenshots of my projector (Casio XJ-S30) and notebook performing the Beamer Latency tool. It’s simple to use. You load up the program on your computer and set the refresh rate to 60hz, mirror the image on the projector, and take a picture with camera set on 1/60th. Since the display is running 60fps (fixed in opengl gamemode) a delay of one bar means 1/60 sec = 16.667ms.
As you can see, my projector (Casio XJ-S30) has less than 1 bar latency which means I have less than 20ms latency which is great. I recommend this tool when testing projectors.
Here’s another video of more software running on the table. This includes “smoke”, “ripples”, “artgen”, “photo”" and my own applications “multiKey” and “MusicalSquares.”
I'm currently doing research and developing a Multi-user, Multi-touch musical interface. This blog space will serve as both a documentation of my own progress as well as an informational space for others to learn and peruse their own Multi-touch techniques and applications.
Recent Comments