By 1817 the Secretary’s staff at Chelsea Hospital had increased in number to such an extent that they requested an increase in office space. This was granted by the Board of Commissioners, who ordered Soane to set about the conversion of Wren’s old Gardener’s House, on the east side of the hospital, for that purpose. At the same time, Soane designed and built a new house for the Hospital gardener, at a cost of £843.2.2, this time on the west side of the hospital, to the south of Soane’s Bakehouse.

Soane made plans for a plain one-storey house, but also for a grander house of two storeys and a recessed porch (SM 67/2/6, SM 67/2/7, SM 27/2/1, SM 67/2/2, SM 67/2/8 and SM 67/2/9) though the exact design varies across this latter group. The more humble design was that eventually employed, perhaps partly because it symmetrically balanced the Bakehouse, further up the West Road. Indeed, the design, proportions and even floor plans are remarkably similar for each building. As a drawing in The National Archives (PRO) Work 31/230 shows, the Gardener’s House had both a basement and an attic, a set of stairs leading to each in a corner room. The Bakehouse appears only to have a basement but also has similar proportions and window spacing. Margaret Richardson suggests that both buildings ‘share the almost primitive style of the stables and are built of commonplace yellow stock brick of one storey with four windows and slate roofs with central chimney stacks’ (p.49). Soane was obviously trying for a unity and symmetry on the west side of the hospital, the side most dominated by his own architecture.

The SM Archive also holds three drawings for the Gardener's House - one plan and two elevations with some verso details (Priv.Corr.IX.J.32-34).