The noteworthy feature of the temple is an inscription above the dwarapalika image, which states that the shrine was constructed by Lokaditya-Ela-Arasa, in honor of the queen of Vinayaditya, called Mahadevi.

Swarga-Brahma is a hall temple with the shrine positioned at the end of the hall. The outer walls of the temple depict Krishna leela and have drawings of animals, garuda-nose faces and matrumurti. One of the new dhyana or meditation mantras or hymns is a wall sculpture entitled Lingodbhavamurti of Shiva. The temple has a six pillar porch on the east, decorated with amalkas. There are two horned dwarpals, Ganga and Jamuna, by the doorway. The temple has a curvilinear Shikhara of the northern style, with a figure of dancing Shiva carved in the Chaitya window of the Sukanasi.