The castle is situated on the limestone cliff, and has been constructed in place of a Slavs settlement and from the 11th century it has become the king's guard castle of the town. The oldest part of the castle is probably the Romanesque tower. The rests of the tower are found in the advanced courtyard. The castle was owned by important royal and gentry families, of which the most famous was Matú Cák of Trencín (from the beginning of the 14th century).