The Horstead Centre stands on the site of successive priests' houses, being itself originally the Rectory for the church of All Saints Horstead next door. The first evidence of a Rectory on this site is 1564.

The Centre still retains close links with both the church, with its Anglo-Saxon foundations, and also the late Medieval Tithe Barn, now converted into the village hall.

Horstead Conference House started in 1965 when work was conducted by the new Rector and volunteer groups of young people to convert the Rectory and outbuildings for use as a 'Residential Training Centre'.

Full time Wardens were appointed in 1987, separating the role of Warden from that of parish rector - a combination which had lasted 17 years. This division enabled the development of the centre and an increase in bookings and usage.

In 1990, the name was changed from the Horstead Conference House to the Horstead Centre, thereby avoiding confusion from potential clients by the use of the word 'conference'. An increasing number of activities since then have attracted more groups, so much so it became an activity centre in the mid 1990's.