The Géza király Square and the area of the former castle is a protected heritage of Vác. This was the spot for the first church of Vác which was built in Gothic style by Géza I.

The castle of Vác was built to protect the bishopric center but by the end of the Ottoman era, only ruins remained. Today, the excavation of the buildings and fortifications of the castle is ongoing, the remains of the barbican can be found in the courtyard of the high school while the reconstructed cannon terrace can be seen behind the church, near the Danube.

Since 2000, there is a statue of King Géza I on the wall of the terrace, who, according to the Chronicon Pictum, was buried in the church that stood here in 1077. The square standing where the medieval city center once was and the school nearby are both named after King Géza.