Ulan Bator was founded in 1995 by Amaury Cambuzat and Olivier Manchion. Near Paris, they discovered an abandoned chalk mine, which they decided to use as a rehearsal space and recording studio. They recorded and produced their first three albums (Ulan Bator, 2°, Végétale) for Les Disques du Soleil et de l’Acier in this space. Several days before starting the recording of the first album, they decided to add a drummer to the band, so drummer Franck Lantignac joined the band from 1995 to 1998, performing at festivlas like Transmusicales de Rennes, Roskilde, Musique Action.