After leaving the New Jersey band Deadguy, vocalist Tim Singer and guitarist Keith Huckins moved on to form Kiss it Goodbye with bassist Thom Rusnack and drummer Andrew Gormley. Huckins, Rusnack and Gormley were already familiar musically as they had all previously performed together in the New Jersey band Rorschach.
A demo tape was quickly recorded and heavily circulated around the New York City area which responded with high praise. The band decided to leave their New Jersey roots and follow Tim to Seattle. The band recorded their 1997 debut LP She Loves Me, She Loves Me Not for Revelation Records. Produced by Billy Anderson, the album had the same familiar sound that fans of Deadguy and Rorschach had come to know along with Singer's melodramatic screams and ramblings. The tracks "Preacher" and "Target Practice" which were omitted from She Loves Me.. were also released this same year as a 7" EP through Revelation.
In 1997, the band toured with Unsane. They also toured with death metal outfit Obituary. Shortly after the tour, Huckins decided the touring and music were no longer to his liking and was replaced by Seattle hardcore veteran Demian "Headboy" Johnston.
The band recorded material in 1998 for an EP that was to be released by Sub Pop Records but was never released by the label as Tim Singer soon decided to leave the band, effectively dissolving it. The tracks were eventually released by Revelation Records as the Choke CD/7" EP.