Built in 1731, the house have been used as the agricultural center by the bishopric for more than two centuries. It has been mostly functioning as a granary, storage, stable, carriage house and the home for some of the servants.

The unique color of the building is the work of builders who were brought from Naples by the bishop of Vác, Michael Friedrich von Althann. The Red House was used as merchant house for a while, today it is being turned into a community and cultural center, it houses a restaurant, a confectionery, a gift shop, and the courtyard serves as a venue for concerts.