Most probably the oldest excavated relic of ancient Balinese art, Goa Gajah is a complex that dates back to the 11th century. The name translates as ‘Elephant Cave’, which is quite mysterious as elephants have never been an indigenous species of Bali. The cave itself is man-made and is believed by archeologists to once serve as a hermitage for Buddhist and Hindu monks – both ideologies are very much present within the complex, displayed through sculptures and architecture. Goa Gajah is tucked in a concave section of a rock wall, and its entrance features the head of a monstrous demon with long menacing fingernails and tusk-like fangs. Inside the chamber, there are 15 niches hollowed out of the cave walls, which was probably used as meditation alcoves, and also proves that Goa Gajah was not a temple, but rather, a center for meditation and hermitage.

The outside of the cave is in the form of vertical-shaped hall, divided into 2 parts and each section has 2 niches. The inside of main room has 11 niches with horizontal shipped. There is a statue of Lord Ganesha set in west corner, meanwhile in the east corner there are 3 on the pedestal and each phallus is surrounded by small phallus. In front of the Elephant Cave, Goa Gahaj are enormous rectangular bathing pools with water fountains. Excavations carried out in 1954 unearthed bathing places in front of the Elephant Cave, Goa Gahaj with six female figures, nymphs or goddesses holding waterspouts.