On April 26, 2011 the group released their debut mixtape, Exmilitary. On February 27, 2012 they signed with Epic and announced the release of two albums for that year. The first, The Money Store, was released on April 24th. The second album, No Love Deep Web, was scheduled to be released in Fall 2012, but the label seemed unwilling to officially release it yet. The band took matters into their own hands and put it online for free, leaving Epic. Their subsequent commercial releases would be made under Harvest. On November 13, 2013 Government Plates was released, again as a free download.
On June 8, 2014 the double album The Powers That B was announced, with the release of its first half, Niggas On The Moon, as a free download. The group publicly announced their apparent disbanding on July 2, 2014, cancelling their scheduled tour dates, and claiming they still planned to release the second half of the album, Jenny Death, later in 2014. After much speculation, it was finally announced it would be released on March 31, 2015. A new tour was announced on March 24.
On October 21st of the same year, they uploaded a video to their YouTube page titled "Bottomless Pit", along with posting on their social media pages that this would be the title for their next album. The album was leaked in its entirety from the band's SoundCloud page via Reddit on April 29th 2016, and officially released on May 6th 2016.