Tried to watch the interview, watched half of it – but fuck that Woulg has some issues, made it difficult to watch, was incredibly cringy.
Otherwise it was very interesting to see how Rob was putting some of those sounds together.
Reminded me, not near as advanced, but I started a project to interpret beatbox sounds into MIDI because the Dubler microphone I got is shit (its flaw is it tries to do it in real time but if you do that you can only analyse the first couple miliseconds of a sounds, which means too much ambiguity, and it gets too many notes wrong, to the point of giving you 5 or 6 consecutive hats).
It’s actually simpler than it sounds though, just find the starts and ends of sounds, then do a fourier transform on them, and find the poles of maximal amplitude in the spectrum within some curve of some Q factor, and match them to configured mappings with MIDI notes.
I don’t even have to write the fourier transform code, which gets very complicated – there are libraries for this.
