Located within the complex of Mukteshvara Temple and its associate shrines, the east-facing sandstone Siddhesvara (Siddheshwar or Siddheswar) Temple, is said to have been constructed during the world rule of Kapilendra in the 15th century A.D.
The present temple is thought to have been constructed on some much older shrine and represents, perhaps, the greatest example of the transition away from the rich embellishment of earlier temple exteriors. The temples of this period began to achieve a grander exterior heightened, more visibly striking look on the landscape- through the elevation of the Gandi, or sanctuary tower.
There is little exterior ornamentation, but two of the niches have sculptures: an east niche with Ganesha on a lotus pedestal where he stands and a south niche with a figure of four-armed Kartikeya.
Inside the temple, you can see a Siva Ling between a circular laterite yonipitha. Set amidst pretty landscaped, manicured grounds, the temple can be easily visited along with the neighboring Mukteshvara Temple. I do recommend a plan to avoid visits on weekends as they can get quite crowded.