Hacker News new | ask | show | jobs
by rrherr 676 days ago
Here's the most impressive results I've seen for automated guitar transcription:

High-resolution guitar transcription via domain adaptation

Demo Videos: https://xavriley.github.io/HighResolutionGuitarTranscription... Paper: https://arxiv.org/abs/2402.15258

> We propose the use of a high-resolution piano transcription model to train a new guitar transcription model. The resulting model obtains state-of-the-art transcription results on GuitarSet in a zero-shot context, improving on previously published methods.

2 comments

The MIDI Guitar software [1] does this in real-time, similar to Rolands hexaphonic pickups, but with a standard guitar signal.

MIDI Guitar 3 is in open beta testing [2] and adds MPE (multidimensional polyphonic expression) MIDI.

[1] jamorigin.com [2] jamorigin.com/beta

Anything as good as this for drum tab transcription?
This isn't exactly what you asked for, but there's a "drumsep" model, which takes a drum audio track and separates it into 6 stems: kick, snare, toms, hi-hat, ride, and crash.

Ctrl+F for "drumsep" in this doc:

Instrumental, vocal & other stems separation & mix/master guide - UVR/MDX/Demucs/GSEP & others - Google Docs https://docs.google.com/document/d/17fjNvJzj8ZGSer7c7OFe_CNf...

I’m the author of the high resolution guitar model posted in a comment above. I have a drum transcription model that I’m getting ready for release soon which should be state of the art for this. I’ll try to update this thread when I’m done