Named after the nearby village of Holt, Holt Street was previously known as Lower Lampit Street and Five Barn Street until the end of the 18th century. Holt Street House stood near the junction with Market Street. Across from the junction with Farndon Street, there was a terrace of poor-quality housing, with the White Horse public house situated in the centre.
Some of these buildings were demolished in 1938 as part of the Borough’s slum clearance program, and the remaining structures were levelled to make way for the inner ring road and the construction of the swimming baths at Bodhyfryd.