[xom]

They tried, but I'm not convinced that they succeeded. Their video resembles Street Fighter in the way that https://youtu.be/-2gJamguN04 resembles Football. It's possible that their mapping works, in that there's some non-unpleasant piano sequence that maps to at least superficially convincing gameplay, but their video didn't show it.

The connection of analog (piano) to digital is impressive. The additional claim of having mapped music to fighting is not yet substantiated.

[crousto]

> The [...] claim of having mapped music to fighting is not yet substantiated.

(project and article co-author here)

Hopefully our writing does not come across as too much of a claim that we reached the single one and only best way to map music to fighting!

Our goal was to bring the most fun from both these worlds combined. Not an easy proposal to make, and obviously a personal one.

The overwhelmingly positive reactions from the audience during the public performance really made our day and validated this proposal to our eyes, but we'd be even happier if the project lived on with third parties pitching in other music/game metaphors. This is why we made it 100% open source/open hardware.

Speaking of the audience, we noticed that people were intimidated or thrilled by the possibility to play piano, others by the possibility to play a Street Fighter game, usually on a mutually exclusive basis. But if they dared to come and play, a balance could be quickly reached, and we considered this a success.

Obviously, it was't always the case. Some moments were just plain unlistenable.

But some other moments during were pure magic. We would like to give immense credit to pianists Alvise Sinivia and Léo Jassef (who appear in the video) from the Conservatoire National de Paris. They are incredibly talented musicians, and they played with our installation long enough that they knew the combos inside and out. It was an absolute delight to see and hear them play/fight during the public event.

PS: Thanks a lot for the Monty Python video :-)

[hurin]

It's neat that they can play a duet that results in actual gameplay; but generally I think you are correct, a player trying only to win would inevitably play something pretty awful sounding. (It would be hard to establish a musical parallel to game play on one piano - let alone two!)

[smtucker]

Someone could do this in reverse, right?

Take the demo of a fight between skilled players and derive what keys they would have had to press on the piano to make it happen. I know that some (most modern fighters?) fighting games have options to show inputs on screen.

[hurin]

Sortof. For one if it could be done it would only work for that particular fight. Even that is highly unlikely though.

For one consider that music at least in terms how we (culturally, or biologically) are predisposed to listening to it: must keep time, you can change from 4/4 to 5/4 in the next section, but not arbitrarily (if you want it to sound like what people are inclined to call music at least).

(i.e. the drum-pad as a controller video someone linked in one of the responses, which is totally non-musical - is a good example).

Of course in a live-fighting game you don't care about structured timing, only about relative timing as to what your opponent is doing. Perhaps you could run a game through an emulator that enforced actions into particular time-blocks. Anyways I think it's very difficult, even to get something satisfactory rhythmically, not to mention tonality and a second piano.

[Retra]

They may not have succeeded, but they did build an infrastructure that could probably handle a true success.