Chastleton Barrow or Burrow is an Iron Agehill fort southeast of the village. It is fortified with a single bank built of oolite and earth that encloses an area of about 3.5 acres (1.4 ha).[2] Part of the fort was excavated in about 1881 and sections of the bank and areas near it were excavated in 1928–29.[3] Hearths were found, along with Iron Age pottery and other artefacts that are now held at the Ashmolean Museum in Oxford.[3] These artefacts were used to date the fort as Early Iron Age,[3] which in Britain is about 800 to 400 BC. The fort is now marked by a ring of mature trees.
In the eastern part of the parish are a number of prehistoric sites including a tumulus that still retains a few of the stones that formed its burial chamber.[4] Archaeological examination of the surface at the centre of the tumulus found three flints that showed signs of being worked and two small fragments of human skull.[4] At Lower Brookend Farm in the north of the parish are the remains of a linear fishpond formed by damming a brook.[5] It is either medieval or post-medieval[6] and seems to have been abandoned by about 1800.[7]
Next to the parish church is Chastleton House, one of England's finest and most complete Jacobean houses, and a Grade I listed building.[9] Completed in 1612, the house has been occupied by members of the Jones family since 1602.[10] It is now owned by The National Trust who opened the property to the public in 1997 after six years of conservation work. The house is full of objects accumulated by the family over the years: rare tapestries, portraits, furniture, as well as personal belongings, some just lying around, such as walking sticks and wellington boots.[11] The gardens are typically Elizabethan and Jacobean, with a ring of topiary at their centre. The middle lawn is regarded as the birthplace of croquet and visitors may play there today with equipment provided by the National Trust.