This is excellent, and something I've been chasing for a long time.
Can you clarify the details of the channel 1 / channel 2 setup you're using? I saw the onscreen text but that sort of confused it for me even more. At what point do they interact? Is there something between the E2 and Pianoteq / the sample player that is negotiating the note-off action?
One thing I'm curious about, as a next step to this, is how one might map the vertical axis of the virtual "key" to instrument timbre -- using a MIDI CC, maybe? -- to change the timbre of the note at the time it's struck, rather than immediately thereafter.
I'm imagining a physical modeling synthesizer that would make a bronze sound played at the bottom of the key, a bamboo sound at the top of key, with a continuous interpolation between the two. (Or morphing smoothly between "gendèr" and "bonang.")
The gotcha, I think is that the Y-axis position has to be transmitted _before_ the note-on, so the appropriate attack transients are generated. This might require API-level access to the E2 and would probably also necessitate using MPE so that each key could have its own timbre.
It's way stupider than it looks! Each "bar" is two keys - the top is a note on channel 1, the bottom is the same note on channel 2. None of those notes are played at all - they go into my webapp that keeps track of what's going on to either play some samples, or send MIDI out to a different port, all on Channel 1 (or damp them).
I could also add frequency to my instrument note info - the real ones are not on the 12EDO western style scale anyway, and synthesize them on the fly in the webapp, or transmit them as MPE (that is, sending pitchbends before the note ons) to the output MIDI port.
This project is under active development, but you (and others) can try these .emk files, and the webapp is on my server at https://arty.fish/MIDI/eraeg.html . The red button in the upper right is an "all notes off" that's sometimes useful if you miss some damping, or your MIDI synth is confused by a bunch of note ons without note offs on the same note. I mostly use modeling synths like Chromophone 3, GeoShred, Pianoteq, Atoms... but some samplers are also good.
When API access makes its way to the ERAE2, I'll be able to push layouts to the devices directly from the webapp I hope, so they can be more customized on the fly. And with the API sending multitouch, multidimensional coordinates, I'll be able to simulate some of my iPad apps on a larger, more playable scale.
Thanks. I was going to ask whether you were using PureData or something for this, but I see from the source that it's Howler.
Look forward to playing/hacking around with this when I get my E2 back from France.
The bad thing about using a MIDI based webapp is that it won't run on browsers that don't support WebMIDI, and I can't take the code, such as it is, and wrap it in an app to be a plugin either. But other than that, turn around time is really fast!
Check out my Autoharp simulation that I started yesterday!
Hey! I updated the webapp so it has some instructions and includes a download link to the project I use to set up the instruments! https://arty.fish/MIDI/eraeg.html .
And now: video
Henry Lowengard
I've been playing both Sundanese and Balinese gamelan music for quite some time, and have been integrating concepts from there into the computer music world. But with the recent arrival of the Erae 2, I can actually simulate the physical playing of a lot of these instruments roughly at the same physical size! The brains for this emulation is in a webapp based MIDI/sound processor.
Gamelan mallet instruments are played with a number of techniques, but chief among them them is playing with one hand while damping with the other (some instruments are damped by the same hand, but I'm not there yet....) This is pretty alienated from MIDI's idea fof what an instrument is, but I get around it by having a row of keys that just handle the damping information, and the row above the "note on" events. Take a look:
https://www.youtube.com/watch?v=HJfRIP23kpU