He is believed to have been the first of the English (post reformation) bishops to have been married, his wife Joan proving his will on 5 October 1551 and he left a son Thomas Randes. According to his descendant, Cater Rand, he was "one of the compilers of the liturgy". Holbeach developed the sweating sickness and died on 2 August 1551 at Nettleham (some accounts give 6 August as date of death) and was buried there on 7 August 1551.