Since 2003, Magnolia Summer has recorded four albums and two digital-only eps via the Undertow Music Collective. Magnolia Summer music has often shape-shifted from delicate indie-folk, strident rock, wistful jangle-pop, and acoustic confessionals.

In 2003, Magnolia Summer released its debut record titled, Levers and Pulleys. The album was praised for its “americana sound somewhere between Son Volt and the Pernice Brothers." In 2005, Magnolia Summer joined Fontella Bass, Bottle Rockets, and Jay Farrar to contribute a song for the Chuck Berry tribute compilation, Brown Eyed Handsome Man: St. Louis Salutes the Father of Rock N’ Roll. In 2006, Magnolia Summer’s second album, From Driveways Lost View, further emphasized the “sense of loneliness, melancholy, and introspection” that were prevalent on the bands’ debut album.

In 2008, St. Louis Magazine also named Grabau one of "Eight Exceptional Stars of the St. Louis Music Scene.

In 2009, Magnolia Summer released their third record, “Lines From The Frame.” The record is credited as being their most expansive album to date with the inclusion of strings by Kevin Buckley, pedal steel by David Anderson and guest vocals from Glossay’s Kelly Kneiser. In 2009 the St. Louis' Riverfront Times named Grabau, “Best St. Louis Songwriter” in the Riverfront Times Best of St. Louis Awards. Also in 2009, Grabau was invited to contribute to the compilation Of Great and Mortal Men: 42 Songs About 42 US Presidents - contributed vocals and organ on Christian Kiefer penned track “William McKinley: Czolgosz’s Dream.”

In 2010, Magnolia Summer was invited to perform at the inaugural LouFest - festival in St. Louis with, She&Him, Jeff Tweedy, Alejandro Escovedo, and the Carolina Chocolate Drops.

In 2011, Magnolia Summer released two digital Eps, The Current Moves and The Slip That Leads Into The Fall. The Eps include b-sides and remixes. André Allen Anjos from the RAC remixed the song “Diminished Returns” and a remix of the song, “Pulling Phase To Ground” included the St. Louis-based horn section, The Funky Butt Brass Band who joined them on a series of live performances. In 2011, Grabau and Horton toured throughout the United Kingdom with Dolly Varden and was an invited for a guest performance on BBC2 by the legendary Bob Harris.

In 2014, Magnolia Summer released its fourth album, The Hill Or The Climb. Recorded at Sawhorse Studio in 2 3-day sessions, the album is their most immediate sounding recording to date. The track “Needles and Pins” includes guest piano by Chuck Berry pianist, Robert Lohr. Mark Ray created the bands’ first video for the song, Needles and Pins. Songwriter Danny Kathriner also contributes piano and backing vocals on the record.