Impaled Nazarene started off as a brutal Black Metal cover band opening for bands such as Amorphis and Sentenced. Eventually, after releasing a couple of demos the band decided to take an unusual path in Black Metal. Attempting to blend top-speed brutality with humor, the Finnish band released "Goat Perversion" in 1992, followed by various other titles. In 2000, after releasing 8 LPs, the band released "Decade Of Decadence", a collection of demos and rare tracks.

The band, however, was never able to become as popular as other bands in the genre (Mayhem, Emperor) as it's blasphemous humor wasn't often appreciated by the fans of the style.