Tavim · how it works
A piano with no samples
Why a sampled piano sounds mechanical, why it can never be your piano, and the piano we built instead.
We wanted two things from a piano. It should sound like a real piano being played. And it should sound like yours.
Why a sampled piano sounds mechanical
A sampled piano is a real instrument, recorded one note at a time. Each key is struck alone, in silence, and left to ring.
But in music no note is ever alone. The hammer meets a string that is still moving from the last time it was struck. The strings beside it are already ringing in sympathy. The pedal is half down. A repeated note interrupts itself.
The sampler has none of that. It has the lone note. So it has to cut: stop one recording, start the next, and join them. However good the recordings, the ear hears the joins. That is the mechanical feeling, and no amount of extra samples removes it, because the number of situations a note can be in has no end.
Why it can never be your piano
A sampler is one instrument, recorded once, in one room. It can be a magnificent piano. It cannot be the upright in your living room.
What nobody had built
The alternative is a piano that learned from real performances, where every note is heard in its true situation. It needs something that did not exist: many different real pianos, hour after hour, each with an exact account of every note and how it was played. One research project had shown the idea could work. Its sound stayed far from the recordings.
We had the missing piece. Tavim takes a recording apart into the score and the performance, so we ran it over a very large collection of real piano recordings and trained a model on the result. It has no samples to trigger. It learned every note inside real music.
How it plays
Give it the notes, the performance, and 15 seconds of any piano. It plays that performance on that piano.
The test
Sixty recordings the model had never heard. Each system received the same notes, and the result was compared with the real recording.
| Tavim | A sampled grand | A modelled (DDSP) piano | An earlier neural prototype | |
|---|---|---|---|---|
| Notes reproduced, of 100 | 96 | 87 | 95 | 74 |
| Sounds closest to its own piano, among 60 | 9 in 10 | 1 in 10 | 3 in 10 | 5 in 10 |
| Tone error, dB (lower is better) | 2.4 | 6.3 | 5.3 | 4.4 |
Ask each to play a recording back. One of them sounds like the piano in that recording.
Your piano, or another
Play your take back on your own instrument, without the phone and the room. Or move the same performance to a bright Steinway, a Yamaha concert grand, a dark Baldwin.