Cave 2 and 3, the paired caves, are believed to be from the Eastern Wei period and are the earliest caves at Tianlongshan. They are located on the eastern side of the Tianlongshan caves site and below the upper level caves. Cave 2 is on the right. The caves are distinctive for the many relief carvings on the walls and ceiling, most of which have been removed.
The cave has a square plan with seated Buddha and bodhisattva images on the back and side walls. Relief figures of Vimalakirti and Manjusri appear at the sides of the main niche on the east wall, and two disciples dressed in monks' robes on the front wall flanking the doorway. The four sloping sides of the ceiling also have relief carvings of four flying apsarases, cloud patterns, and lotus blossoms around a large central lotus. Now only the central lotus remains on the ceiling.