Teach Jazz Improv from the Inside Out (Free PDF Sheet music)
My article "Play What You Hear: Jazz Improv from the Inside Out" just came out in PMEA News, Summer 2026. If you read it and are interested in learning more, welcome! And if you just happened upon this blog post, welcome too. This is a quick summary of the ideas, plus some free sheet music downloads you can use with your students.
"Only play what you hear. If you don't hear anything, don't play anything." - Chick Corea
The great jazz pianist Chick Corea said this in a Q&A at Berklee in 1985 - it was advice he'd gotten years earlier from Miles Davis himself. Just play what you hear. Many aspiring jazz musicians have heard this same advice - but what does that really mean, and how do we get there?
The short version
Often times, beginning jazz improv starts off the same way: hand a student a lead sheet, a chord symbol, a scale, and go. It gets kids playing fast, but it tends to train students to use their eyes instead of their ears. Their attention becomes focused, and often overwhelmed, by decoding symbols and trying to push the "right" buttons at the right time. The result is a very familiar sound: students who struggle to keep their place in the form, phrasing that feels rhythmically awkward, lines with no real melodic shape, and not much swing or flow. They may even be playing mostly the "right" notes, and it still doesn't sound like music. Every school band director knows this sound. So does every jazz festival adjudicator, right before they write "needs to swing more" on the comment sheet for the fourth year in a row.
The inside-out approach flips that order. Students build their solos out of what they can already hear, in three stages:
1. Melody. Learn the tune by ear, phrase by phrase, until it's second nature. Then start varying it: rhythm first, then small melodic decorations. The melody stays home base, and students always know how to find their way back to it.
2. Chord roots. Learn the bass line against the melody. This is what builds a real sense of harmonic motion, helps students track where they are in the form by ear, and makes progressions like ii-V start to feel familiar before you've even named them.
3. Harmony line. A guide-tone countermelody, taught the same way by ear, as its own tune. That way the harmony becomes something students hear, not just something they memorize on paper.
Theory comes after, once students already have the sound in their ear. That's the whole point.
Applying this to a real tune
When I'm introducing this approach to students, I like to start with tunes that keep things simple: a short, straightforward form and a melody that's mostly diatonic, so students aren't fighting the harmony while they're still learning to trust their ears. Tunes like "Mack the Knife," "Summertime," and "When the Saints Go Marching In" are great for this. They're short 16-bar forms with singable, memorable melodies. Once students have their footing, you can move them into longer 32-bar standards like "Autumn Leaves" or "Fly Me to the Moon."
Let's walk through how this actually looks, using "When the Saints Go Marching In."
Step 1: Melody
Teach the melody by ear, phrase by phrase, using call and response.
Have students play it repeatedly with accompaniment so they feel how it sits in the harmony. The goal is to get complete confidence and mastery in playing the melody.
Rotate roles: some students play the melody while others play the chord roots or just listen.
Teach the lyrics too. They shape the phrasing and give students a reason to breathe in the right places.
Once the melody is solid, start varying it: rhythm first, then small decorations using the home scale. Frame it as "venturing away from home," the melody is home base, and students should always know how to find their way back.
(excerpt from student sheet music - free donwload below!)
Step 2: Chord roots
Have students learn and play the bass line's root motion.
Add rhythmic and melodic variation to the roots once they're comfortable.
Split the group: one section plays melody, another plays roots, a third improvises.
Try a "drop the needle" game: start a play-along at a random spot and see if students can find their place by ear.
Step 3: Harmony line
A harmony line is a secondary melodic part (you could call it an accompaniment line or a countermelody) that brings out chord tones and resolutions the melody doesn't already cover, helping students develop an ear for the other notes that outline the the chord progression.
Unlike the melody and chord roots, which are pretty much set by the tune itself, the harmony line is where you as the teacher get to be a little creative.
Just as we do with the melody, teach the harmony line be ear if possible.
Combine it with the melody so students hear how the two lines outline the harmony together.
Split into three groups: melody, harmony line, chord roots.
Once students know all three parts, let them draw from any of them when they improvise.
Teaching materials
Built around "When the Saints Go Marching In," the tune I use in the article. Each download is a two-page sheet with the melody, root motion, and harmony line for that instrument, in its own key:
A few tips for teaching
Teach by ear and call-and-response as much as you can. Sheet music is a backup, not the goal. The goal is always memorization.
Rotate roles within the group (melody, roots, harmony line, improviser) so everyone hears how the parts fit together, not just their own part.
Model it yourself first, on voice or instrument, before asking students to try it.
Read the article
The full piece goes deeper into the reasoning behind each step, the Chick Corea/Miles Davis story behind "play what you hear," and why this approach makes traditional theory click better once you get there.
Comments