Sound and Music Computing
Yichen Wang & Dr Charles Martin
key
, mouse
, joystick
, etc.More interaction options beyond your computer?
Task-oriented interface design
Digital sound layer
Preserve the interaction complexity and playing virtuosity
Extending the clarinet’s bell through the performer’s motion and gestures
Extra pitch bending and note playback options with visuals
A custom-designed electrodynamic pickup capturing the velocity of each string
Accessible guitar instrument - touch screen guitar (?!)
When is a Guitar not a Guitar? Cultural Form, Input Modality and Expertise, NIME2018
Percussion-inspired?
A granular synthesis component in Pd
Freehand gestures and embodiment
Imaginary?
… or I haven’t clearly figured out yet!
Exploring three art forms: acting, percussion, and drawing through new interactive technologies and experimental performance
Inspired by the classic science-fiction short story “Twilight” by John W. Campbell
Connection between an action in the environment to sonic output
Steps in Mapping:
Check out Captain Credible for more Micro:bit works/ideas!
// set communication channel
radio.setGroup(1)
// proxies all radio buffers to serial
radio.onReceivedBuffer(function (buffer) {
serial.writeBuffer(buffer)
// light on showing receiving in-progress
led.toggle(4, 4)
})
radio.setGroup(1)
let accelx = 0
// set midi channel
let accelx_send = midi.channel(1)
basic.forever(function () {
// access accelerometer data
accelx = input.acceleration(Dimension.X)
// some sound representation
...
// note "bang"
accelx_send.noteOn(accelx_note)
})
// send midi messages over radio transmission
midi.setTransport(function (data: Buffer) {
radio.sendBuffer(data);
})
Thanks to Charles - he got you something to start with.