Former professional footballer Paul McGregor (Honey), his brother Benn (MCG), and guitarist Paul Simmons (Simmons) began as a three piece band in late 2006. Shortly after in 2007, Karl Januskevicius, of Motorcycle Boy, joined Ulterior full time on synthesizer.
After some performances in London and their debut single "Weapons", Ulterior were asked to support The Horrors at the Shockwaves NME Awards 2008 at The London Astoria.
In 2008 the band was mentioned by The Quietus as "consistently playing some of the most intense gigs in the past couple of years". The band then toured Europe with The Sisters Of Mercy in 2009. Ulterior then released their follow-up single, a 10" double AA side vinyl entitled "Sister Speed / Aporia".
2008 saw Januskevicius move onto bass guitar. In February 2009 Januskevicius quit the band citing health and personal problems on the eve of their European tour with The Sisters Of Mercy. Januskevicius was replaced by Michael Ellis (Mickey).
Ulterior have featured in printed press such as NME, The Stool Pigeon, Vice Magazine and Artrocker.
Ulterior have worked with Zlaya Hadzic, a Bosnian born music producer based at Amsterdam's famous Studio 150. Zlaya has recorded and mixed Sonic Youth and Tortoise.