Feeble little horse was formed in early 2021 by guitarists Sebastian Kinsler and Ryan Walchonski, who first played together in a short-lived garage rock band.[1] The duo enlisted the help of drummer Jake Kelley to release a debut project.[1] Feeble little horse's first EP, modern tourism, was released in May 2021.[2] The band expanded to include singer and bassist Lydia Slocum, who had previously collaborated with Kinsler under the name 'kiddie' since early 2021. feeble little horse released their debut full-length album, Hayday, through Philadelphia label Julia's War Recordings in October 2021.[3] The group signed to Saddle Creek Records in October 2022, and rereleased Hayday both through the label and their Unstable Collective imprint, expanding the tracklist to include a bonus track, "Dog Song 2," and a remix of Hayday track "Termites" by the Philadelphia-based shoegaze band Full Body 2.[4] The album's second single, "Chores," received praise from the New York Times and Pitchfork upon rerelease.[5][6]
On February 27, 2023, feeble little horse announced their second album with Saddle Creek, Girl with Fish, and issued the album's first single, "Tin Man." The single was followed by a second track, "Steamroller," on April 4, 2023, and a third track, "Pocket," on May 10, 2023. The album was released on June 9, 2023.[7][8] A three-week tour of the album across the United States was cancelled on June 22, 2023, three days before it was set to commence. In a message on Instagram, the band stated they would "have to take a step back and reassess [their] little world for [their] continued health."[9][10]
The band officially returned from their live hiatus on January 16, 2024, when they announced an appearance at the 2024 Coachella festival. They played their first official public live show back In Ames, Iowa on February 17, 2024.