Their first single, Apathy (1988), contains "Apathy" and "Better Ways", which were both originally intended for Ministry's The Land of Rape and Honey, but rejected for not fitting in with the more aggressive sound of album.
Their second single, Supernaut (1990), contains "Supernaut" (a Black Sabbath cover) and "Hey Asshole", which were both recorded specifically for the project. The cover art closely resembles Black Sabbath's Master of Reality. The CD release of Supernaut combines the two singles.
"Supernaut" could not be released with Trent Reznor's vocals, due to legal problems with Reznor's label TVT Records. The story goes that Al distorted the vocals and claimed them as his own, although he, himself, has signaled that they are actually his own vocals. Years later, the original version was released on the Wax Trax! Black Box compilation.