Hacker News new | ask | show | jobs
by jessejengel 2348 days ago
DDSP modules are helpful in situations where you want to impose some level of interpretability and modularity. Most also don't have parameters themselves, but must have them provided by another network or variable. So you could imagine for instance feeding your data through a NN that then predicts filter coefficients, then running the same data through a filter with those coefficients (if you wanted to enforce time-varying linearity for interpretability let's say).
2 comments

I don't know much about DSP, neural nets, and audio, but I am really intrigued by this project. If you have a second, could you give a simple example of how this approach could be applied to problems outside of audio?
So I'm using the gradients "grad" of the second network (the DDSP) to make a loss function for the first network, such as |grad|^2?