Built on the north-eastern slope of the castle hill, it is a two-storey, gabled Baroque building.
From 1753 it was a six-form grammar school. In 1783 an extension was begun to accommodate the national school. The first floor was completed in 1821.
During the War of Independence, the former school was occupied by the imperial army. In the 1890s, the second floor of the Gymnasium was completed, and at the turn of the century, the banqueting hall and the drawing room were added, designed by Henrik Schmahl.
Between 1914-1918 and 1944-1945 the building was occupied by the army. By 1948, the reconstruction of the Gymnasium was completed and it was nationalised in the same year.
From 1968 to 2008, the Veszprém Secondary School of Public Administration was housed here, but it moved out of the building in 2008 due to dilapidation.