Back to Main Page

Note-base Tone Transfer

The proposed system synthesize audio based on note-wise features. Thus, note transfer can be done by first extracting note boundaries and control parameters from source audio, and synthesize audio using target instrument. To synthesize audio in the target instrument, each extracted control parameter is shifted by the mean of the control parameters in the dataset of the target instrument.

This section presents audio samples of note-base tone transfer results compared with original DDSP note transfer results. Comparing to original DDSP tone transfer which use frame-wise acoustic features, the proposed method can generate more idiomatic and realistic tone transfer results. Please in note in original DDSP note transfer, some samples fails to generate consistent volume in a note and fails to generate the attack of the note. (Some tone transfer also shifted the pitch of the source audio to match the pitch range of target instrument) (There can be other ways to shift the parameters)

Violin to Guitar

Violin to Guitar
Source Source Source Source
Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP
Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours

Guitar to Violin

Guitar to Violin
Source Source Source Source
Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP
Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours

Guitar to Sax

Guitar to Sax
Source Source Source Source
Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP
Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours

Sax to Guitar

Sax to Guitar
Source Source Source Source
Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP
Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours

Violin to Sax

Violin to Sax
Source Source Source Source
Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP
Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours

Sax to Violin

Sax to Violin
Source Source Source Source
Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP Tone Transfer DDSP
Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours Tone Transfer Ours