The Renaissance farm yard, one part of which still has a unique vault, stood east of the fortress and at the time of its greatest boom was the central yard for the vast estate from Konopiště to Komorní Hrádek. At the beginning of the 18th century, the construction of a Baroque chateau was started in the north-west corner of the courtyard.
This knight's mansion built for Jan František of Vrbno and Bruntál was originally intended to serve as a replacement for the poorly comfortable castle, but around 1727 it was abandoned, burnt down and ruined. Some sources mistakenly state that the mansion was not completed, but even though its existence was short-lived, in 1720 it had three wings with the then modern "court of honour" and measured 40 x 20 m. According to the description in the town plan of the same year, this manor house is listed as a brick building with three rooms for the manor, a dining room and a chapel on the first floor. On the ground floor there was an office room, the governor's room, the grain scribe's dwelling, two kitchens and two storerooms. A small pond and a garden were built near the north-east wing. Today's visitors can admire the ruins of the perimeter masonry with window arches.