In Person (Compilation)
- Blues for trombone
- Bernie's Tune
- Sophisticated Lady
- Jackie-Ing
- Me Too
- Stardust
- Satin Doll
- Out of nowhere
- Indiana
- I'll remember April
- If I had you
- Pharaoh
- Poem for Brass: I. Introduction and First Movement
- Poem for Brass: II. Second Movement
- Poem for Brass: III. Third Movement - Finale
- Three Little Feelings: I. Feeling No. 1
- Three Little Feelings: II. Feeling No. 2
- Three Little Feelings: III. Feeling No. 3
The Eminent Volumes 1 & 2 (Compilation)
The Columbia Albums Collection 1956 - 1961 (Compilation)
- Naptown USA
- It Might as Well Be Spring
- Tumbling tumbleweeds
- Angel Eyes
- Solar
- Overdrive
- Undecided
- Never Let Me Go
- Chasin' the Bird
- Cube Steak
- It's Only a Paper Moon
- Paul's Pal
- For Heaven's Sake
- Commutation
- Harvey's House
- That Tired Routine Called Love
- Be My Love
- Cry Me a River
- Nickels and Dimes
- Hello, Young Lovers
- Kev
- What's New
- Blue Trombone, Part I
- Blue Trombone, Part II
- Gone With the Wind
- 100 Proof
- Tea Pot
- Barbados
- In a Little Provincial Town
- Cette Chose (von The J.J. Johnson Quintet)
- Blue Haze
- Love Is Here to Stay (von The J.J. Johnson Quintet)
- So Sorry Please
- It Could Happen to You (von The J.J. Johnson Quintet)
- Bird Song (von The J.J. Johnson Quintet)
- Old Devil Moon
- Tune Up (Live in 1958)
- Laura (Live in 1958)
- Walkin' (Live in 1958)
- What Is This Thing Called Love? (Live in 1958)
- Mysterious (Live in 1958)
- My Old Flame (Live in 1958)
- Now's the Time (Live in 1958)
- Me Too (Live in 1958)
- Decision (Live in 1958)
- I Got It Bad and That Ain't Good (Live in 1958)
- Red Cross (Live in 1958)
- Almost Like Being in Love (Live in 1958)
- Stardust (Live in 1958)
- Sidewinder (Live in 1958)
- God Bless the Child (Live in 1958)
- Speak Low (Live in 1958)
- Jennie's Song
- Only the Lonely
- Sometimes I Feel Like a Motherless Child
- In a Sentimental Mood
- Get Out of Town
- I'm Glad There Is You
- You're My Girl
- To the Ends of the Earth
- What Is There to Say
- Lazy Bones
- Mohawk
- Minor Mist
- In Walked Horace
- Fatback
- Aquarius
- Shutterbug
Plays Mack The Knife + Trombone And Voices (Compilation)
- Overture (von André Previn & J.J. Johnson)
- Seeräuber Jenny
- Surabaya-Johnny (von André Previn & J.J. Johnson)
- Portrait Of Jenny
- Only The Lonely
- Sometimes I Feel Like A Motherless Child
- In A Sentimental Mood
- Get Out Of Town
- I'm Glad There Is You
- You're My Girl
- To The Ends Of The Earth
- What Is There To Say
- Lazy Bones
