Chrząstów is now a district of Koniecpol, but earlier it was an independent settlement mentioned a long time ago, because in the 1136, when it was a property of the archbishop of Gniezno. Later, the local lands belonged to the Pobóg family who made it their seat. Initially, there was a typical medieval castle on the backwaters of the Pilica river. Later, a residence was built on a site (around the turn of the fifteenth and sixteenth centuries). It rebuilt several times in the next centuries.